[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:11 dist-test-slave-07c2 krb5kdc[10946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:11 dist-test-slave-07c2 krb5kdc[10946](info): set up 2 sockets
Aug 07 18:43:11 dist-test-slave-07c2 krb5kdc[10946](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 18:43:12.085104 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:12.210429 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38513
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38513
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:12.324563 10959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:12.324898 10959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:12.324981 10959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:12.328935 10959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:12.329020 10959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:12.329059 10959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:12.329116 10959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:12.329156 10959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:12.334554 10959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:12.335923 10959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:12.337172 10959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:43:12.347743 10959 server_base.cc:1034] running on GCE node
W20260807 18:43:12.347703 10965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:12.348623 10967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:12.348953 10964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:12.349615 10959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:12.351121 10959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:12.352286 10959 hybrid_clock.cc:648] HybridClock initialized: now 1786128192352271 us; error 62 us; skew 500 ppm
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:12.355089 10959 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:12.356243 10959 webserver.cc:460] Webserver started at http://127.10.174.254:45937/ using document root <none> and password file <none>
I20260807 18:43:12.356854 10959 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:12.356946 10959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:12.357189 10959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:12.359261 10959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "a3545adec4314b87bb5922d37f154b70"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "9d640cb138f2e86c3f64c415c7506f96"
server_key_iv: "62250ef26cfadc9886f15eac109516cf"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.359889 10959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "a3545adec4314b87bb5922d37f154b70"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "9d640cb138f2e86c3f64c415c7506f96"
server_key_iv: "62250ef26cfadc9886f15eac109516cf"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.363945 10959 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:43:12.366390 10974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.367674 10959 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:12.367864 10959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "a3545adec4314b87bb5922d37f154b70"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "9d640cb138f2e86c3f64c415c7506f96"
server_key_iv: "62250ef26cfadc9886f15eac109516cf"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.367978 10959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:12.396945 10959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:12.400624 10959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:12.400872 10959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:12.410346 10959 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38513
I20260807 18:43:12.410393 11029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38513 every 8 connection(s)
I20260807 18:43:12.411583 10959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:12.415351 11030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:12.417025 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 10959
I20260807 18:43:12.417186 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:12.418488 10939 external_mini_cluster.cc:1428] Setting key b74e269b12d8c246154eee3fed7a45bc
I20260807 18:43:12.422463 11030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70: Bootstrap starting.
I20260807 18:43:12.425407 11030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:12.426512 11030 log.cc:824] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:12.428695 11030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70: No bootstrap required, opened a new log
I20260807 18:43:12.432307 11030 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3545adec4314b87bb5922d37f154b70" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38513 } }
I20260807 18:43:12.432610 11030 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:12.432714 11030 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3545adec4314b87bb5922d37f154b70, State: Initialized, Role: FOLLOWER
I20260807 18:43:12.433354 11030 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3545adec4314b87bb5922d37f154b70" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38513 } }
I20260807 18:43:12.433531 11030 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:12.433673 11030 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:12.433825 11030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:12.434731 11030 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3545adec4314b87bb5922d37f154b70" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38513 } }
I20260807 18:43:12.435197 11030 leader_election.cc:302] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3545adec4314b87bb5922d37f154b70; no voters:
I20260807 18:43:12.435662 11030 leader_election.cc:288] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:12.435757 11035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:12.436053 11035 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [term 1 LEADER]: Becoming Leader. State: Replica: a3545adec4314b87bb5922d37f154b70, State: Running, Role: LEADER
I20260807 18:43:12.436452 11035 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3545adec4314b87bb5922d37f154b70" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38513 } }
I20260807 18:43:12.437371 11030 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:12.439075 11037 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3545adec4314b87bb5922d37f154b70. Latest consensus state: current_term: 1 leader_uuid: "a3545adec4314b87bb5922d37f154b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3545adec4314b87bb5922d37f154b70" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38513 } } }
I20260807 18:43:12.439198 11037 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:12.439829 11045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:12.440328 11036 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3545adec4314b87bb5922d37f154b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3545adec4314b87bb5922d37f154b70" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38513 } } }
I20260807 18:43:12.440747 11036 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:12.445278 11045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:12.446107 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:12.422965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38344 (local address 127.10.174.254:38513)
0807 18:43:12.423418 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:12.423434 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:12.424597 (+ 1163us) server_negotiation.cc:407] Connection header received
0807 18:43:12.428039 (+ 3442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:12.428053 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:12.428411 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:12.428738 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:12.431284 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.433092 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.434440 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.434958 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.435134 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:12.440386 (+ 5252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:12.440399 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:12.440422 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:12.440453 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:12.442479 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:12.443017 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:12.443023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:12.443030 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:12.443147 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:12.443522 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:12.443526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:12.443527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:12.443982 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:12.444212 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:12.444792 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 18:43:12.445063 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":139,"threads_started":1}
I20260807 18:43:12.454303 11045 catalog_manager.cc:1347] Generated new cluster ID: 50aec9cabaf8490d847fce8ae89cda2a
I20260807 18:43:12.454363 11045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:12.485193 11045 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:12.486675 11045 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:12.494220 11045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3545adec4314b87bb5922d37f154b70: Generated new TSK 0
I20260807 18:43:12.495177 11045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:12.534642 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38513
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:12.648083 11056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:12.648353 11056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:12.648464 11056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:12.652556 11056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:12.652630 11056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:12.652716 11056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:12.657882 11056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38513
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:12.658936 11056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:12.659946 11056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:12.670491 11065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:12.670490 11063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:12.670547 11062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:12.670735 11056 server_base.cc:1034] running on GCE node
I20260807 18:43:12.671139 11056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:12.671789 11056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:12.672977 11056 hybrid_clock.cc:648] HybridClock initialized: now 1786128192672961 us; error 33 us; skew 500 ppm
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:12.675974 11056 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:12.676818 11056 webserver.cc:460] Webserver started at http://127.10.174.193:44541/ using document root <none> and password file <none>
I20260807 18:43:12.677322 11056 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:12.677380 11056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:12.677536 11056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:12.679620 11056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "e1d67ee8c8894336bb37d6f087de646b"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "196de00ad830c0dc6ddd7e609a66a4f9"
server_key_iv: "f1df72c54afe463b9536468531751b94"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.680176 11056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "e1d67ee8c8894336bb37d6f087de646b"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "196de00ad830c0dc6ddd7e609a66a4f9"
server_key_iv: "f1df72c54afe463b9536468531751b94"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.683920 11056 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 18:43:12.686168 11072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.687371 11056 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:12.687486 11056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "e1d67ee8c8894336bb37d6f087de646b"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "196de00ad830c0dc6ddd7e609a66a4f9"
server_key_iv: "f1df72c54afe463b9536468531751b94"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.687585 11056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:12.715549 11056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:12.718979 11056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:12.719205 11056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:12.719946 11056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:12.721004 11056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:12.721055 11056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.721130 11056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:12.721164 11056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.731536 11056 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:46397
I20260807 18:43:12.731570 11189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:46397 every 8 connection(s)
I20260807 18:43:12.732388 11056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:12.741701 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11056
I20260807 18:43:12.741816 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:12.742132 10939 external_mini_cluster.cc:1428] Setting key 3347ca20f21aeaf647f7544ab04c8ed3
I20260807 18:43:12.746623 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:12.734309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:39289 (local address 127.10.174.254:38513)
0807 18:43:12.734468 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:12.734473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:12.735307 (+ 834us) server_negotiation.cc:407] Connection header received
0807 18:43:12.736716 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:12.736719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:12.736765 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:12.736840 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:12.738005 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.738680 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.739915 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.740144 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.740233 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:12.742676 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:12.742679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:12.742681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:12.742704 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:12.744229 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:12.744926 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:12.744928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:12.744929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:12.745009 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:12.745417 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:12.745419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:12.745420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:12.745699 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:12.745810 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:12.746260 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 18:43:12.746408 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:43:12.747231 11192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:12.734660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38513 (local address 127.10.174.193:39289)
0807 18:43:12.735145 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:12.735185 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:12.736511 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:12.736992 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:12.736998 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:12.737417 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:12.737880 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:12.737892 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.738802 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.738805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:12.739786 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:12.739795 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.740276 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.740279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:12.740411 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:12.740914 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:12.740929 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:12.742485 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:12.744401 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:12.744410 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:12.744426 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:12.744814 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:12.745100 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:12.745106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:12.745111 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:12.745317 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:12.745815 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:12.745820 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:12.746027 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 18:43:12.746181 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 18:43:12.746407 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":177,"threads_started":1}
I20260807 18:43:12.748621 11190 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38513
I20260807 18:43:12.748855 11190 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:12.749307 11190 heartbeater.cc:511] Master 127.10.174.254:38513 requested a full tablet report, sending...
I20260807 18:43:12.751549 10991 ts_manager.cc:194] Registered new tserver with Master: e1d67ee8c8894336bb37d6f087de646b (127.10.174.193:46397)
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:12.753369 10991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:39289
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:12.770502 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38513
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:12.886508 11195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:12.886752 11195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:12.886827 11195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:12.891088 11195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:12.891158 11195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:12.891261 11195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:12.896760 11195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38513
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:12.897753 11195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:12.898694 11195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:12.908195 11201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:12.908142 11203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:12.908174 11200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:12.908505 11195 server_base.cc:1034] running on GCE node
I20260807 18:43:12.908981 11195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:12.909617 11195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:12.910784 11195 hybrid_clock.cc:648] HybridClock initialized: now 1786128192910770 us; error 30 us; skew 500 ppm
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:12.913641 11195 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:12.914502 11195 webserver.cc:460] Webserver started at http://127.10.174.194:35459/ using document root <none> and password file <none>
I20260807 18:43:12.915066 11195 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:12.915158 11195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:12.915462 11195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:12.917629 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "3660f8ef6b774757acb4d3e315f13e4f"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "ed9349cfba815449441ad7bac36ef922"
server_key_iv: "a0671c978a92ab0430c847be10f2b276"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.918196 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "3660f8ef6b774757acb4d3e315f13e4f"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "ed9349cfba815449441ad7bac36ef922"
server_key_iv: "a0671c978a92ab0430c847be10f2b276"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.921976 11195 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:12.924407 11211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.925580 11195 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:12.925711 11195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "3660f8ef6b774757acb4d3e315f13e4f"
format_stamp: "Formatted at 2026-08-07 18:43:12 on dist-test-slave-07c2"
server_key: "ed9349cfba815449441ad7bac36ef922"
server_key_iv: "a0671c978a92ab0430c847be10f2b276"
server_key_version: "encryptionkey@0"
I20260807 18:43:12.925830 11195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:12.955477 11195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:12.958130 11195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:12.958329 11195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:12.959022 11195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:12.959854 11195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:12.959925 11195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.959996 11195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:12.960048 11195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:12.969395 11195 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:40153
I20260807 18:43:12.969427 11325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:40153 every 8 connection(s)
I20260807 18:43:12.970261 11195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:12.977521 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11195
I20260807 18:43:12.977645 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:12.977908 10939 external_mini_cluster.cc:1428] Setting key c7b963e590ab7e636e30fd90e944d308
Aug 07 18:43:12 dist-test-slave-07c2 krb5kdc[10946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128192, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:12.983932 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:12.972099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:34425 (local address 127.10.174.254:38513)
0807 18:43:12.972238 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:12.972242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:12.973058 (+ 816us) server_negotiation.cc:407] Connection header received
0807 18:43:12.974298 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:12.974301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:12.974355 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:12.974459 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:12.975553 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.976073 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.977174 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.977405 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.977517 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:12.980151 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:12.980158 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:12.980164 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:12.980198 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:12.981827 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:12.982416 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:12.982418 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:12.982419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:12.982487 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:12.982879 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:12.982881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:12.982882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:12.983035 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:12.983107 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:12.983731 (+ 624us) server_negotiation.cc:299] Negotiation successful
0807 18:43:12.983822 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:43:12.985013 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:12.972448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38513 (local address 127.10.174.194:34425)
0807 18:43:12.972929 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:12.972968 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:12.974099 (+ 1131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:12.974619 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:12.974625 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:12.974946 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:12.975418 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:12.975432 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.976196 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.976200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:12.977049 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:12.977058 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:12.977553 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:12.977557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:12.977799 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:12.978335 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:12.978351 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:12.979990 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:12.981943 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:12.981951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:12.981964 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:12.982319 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:12.982580 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:12.982586 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:12.982589 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:12.982784 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:12.983139 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:12.983147 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:12.983480 (+ 333us) client_negotiation.cc:769] Sending connection context
0807 18:43:12.983674 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 18:43:12.984011 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":117,"threads_started":1}
I20260807 18:43:12.986125 11326 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38513
I20260807 18:43:12.986346 11326 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:12.986778 11326 heartbeater.cc:511] Master 127.10.174.254:38513 requested a full tablet report, sending...
I20260807 18:43:12.987740 10991 ts_manager.cc:194] Registered new tserver with Master: 3660f8ef6b774757acb4d3e315f13e4f (127.10.174.194:40153)
I20260807 18:43:12.988315 10991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:34425
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:13.004254 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38513
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:13.116034 11331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:13.116251 11331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:13.116328 11331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:13.120327 11331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:13.120375 11331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:13.120471 11331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:13.125488 11331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38513
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:13.126402 11331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:13.127373 11331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:13.136726 11339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:13.136801 11337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:13.136803 11336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:13.137025 11331 server_base.cc:1034] running on GCE node
I20260807 18:43:13.137414 11331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:13.138028 11331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:13.139200 11331 hybrid_clock.cc:648] HybridClock initialized: now 1786128193139182 us; error 29 us; skew 500 ppm
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128193, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:13.142024 11331 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:13.142896 11331 webserver.cc:460] Webserver started at http://127.10.174.195:36885/ using document root <none> and password file <none>
I20260807 18:43:13.143499 11331 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:13.143563 11331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:13.143839 11331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:13.145820 11331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "fd79f000c14248beb488ebe804271e71"
format_stamp: "Formatted at 2026-08-07 18:43:13 on dist-test-slave-07c2"
server_key: "5680d75158aabc7badfcd94fe73d8386"
server_key_iv: "512559f03331fb04c869300fb401ea24"
server_key_version: "encryptionkey@0"
I20260807 18:43:13.146441 11331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "fd79f000c14248beb488ebe804271e71"
format_stamp: "Formatted at 2026-08-07 18:43:13 on dist-test-slave-07c2"
server_key: "5680d75158aabc7badfcd94fe73d8386"
server_key_iv: "512559f03331fb04c869300fb401ea24"
server_key_version: "encryptionkey@0"
I20260807 18:43:13.150275 11331 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:13.152563 11346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:13.153692 11331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:13.153849 11331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "fd79f000c14248beb488ebe804271e71"
format_stamp: "Formatted at 2026-08-07 18:43:13 on dist-test-slave-07c2"
server_key: "5680d75158aabc7badfcd94fe73d8386"
server_key_iv: "512559f03331fb04c869300fb401ea24"
server_key_version: "encryptionkey@0"
I20260807 18:43:13.153975 11331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:13.166419 11331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:13.168962 11331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:13.169099 11331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:13.169564 11331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:13.170310 11331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:13.170362 11331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:13.170398 11331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:13.170419 11331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:13.180155 11331 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:37683
I20260807 18:43:13.180204 11466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:37683 every 8 connection(s)
I20260807 18:43:13.180990 11331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[10946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128193, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:13.190171 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11331
I20260807 18:43:13.190296 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:13.190564 10939 external_mini_cluster.cc:1428] Setting key 7caafd7b7280965187d6f365cd17a9ac
I20260807 18:43:13.194226 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:13.182628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:50091 (local address 127.10.174.254:38513)
0807 18:43:13.182767 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:13.182771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:13.183570 (+ 799us) server_negotiation.cc:407] Connection header received
0807 18:43:13.184861 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:13.184865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:13.184921 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:13.184997 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:13.186058 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.186590 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.187706 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.187934 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.188044 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:13.190440 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:13.190443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:13.190445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:13.190469 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:13.192110 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:13.192726 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:13.192728 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:13.192729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:13.192809 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:13.193197 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:13.193201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:13.193202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:13.193384 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:13.193492 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:13.193948 (+ 456us) server_negotiation.cc:299] Negotiation successful
0807 18:43:13.194062 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:43:13.194929 11470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:13.182966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38513 (local address 127.10.174.195:50091)
0807 18:43:13.183430 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:13.183471 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:13.184654 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:13.185149 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:13.185155 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:13.185480 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:13.185911 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:13.185923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.186716 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.186720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:13.187577 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:13.187586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.188079 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.188083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:13.188242 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:13.188743 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:13.188767 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:13.190203 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:13.192217 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:13.192221 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:13.192249 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:13.192634 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:13.192900 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:13.192903 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:13.192905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:13.193079 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:13.193492 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:13.193499 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:13.193719 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 18:43:13.193905 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 18:43:13.194196 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":115,"threads_started":1}
I20260807 18:43:13.195945 11467 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38513
I20260807 18:43:13.196164 11467 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:13.196606 11467 heartbeater.cc:511] Master 127.10.174.254:38513 requested a full tablet report, sending...
I20260807 18:43:13.197510 10991 ts_manager.cc:194] Registered new tserver with Master: fd79f000c14248beb488ebe804271e71 (127.10.174.195:37683)
I20260807 18:43:13.198041 10991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:50091
I20260807 18:43:13.205165 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128193, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[10946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128193, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:13.231707 11475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:13.222417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48364 (local address 127.10.174.193:46397)
0807 18:43:13.222704 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:13.222720 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:13.222747 (+ 27us) server_negotiation.cc:407] Connection header received
0807 18:43:13.222864 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:13.222869 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:13.223050 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:13.223201 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:13.223926 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.224677 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.225511 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.225871 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.225992 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:13.228265 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:13.228274 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:13.228286 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:13.228307 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:13.229925 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:13.230347 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:13.230353 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:13.230355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:13.230441 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:13.230718 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:13.230723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:13.230724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:13.230955 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:13.231187 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:13.231385 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 18:43:13.231534 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":67,"threads_started":1}
W20260807 18:43:13.232615 11101 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48364
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[10946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[10946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:13.257390 11475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:13.249675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48374 (local address 127.10.174.193:46397)
0807 18:43:13.249803 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:13.249807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:13.249988 (+ 181us) server_negotiation.cc:407] Connection header received
0807 18:43:13.250090 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:13.250092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:13.250131 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:13.250200 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:13.250793 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.251324 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.252087 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:13.252311 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:13.252384 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:13.254525 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:13.254528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:13.254530 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:13.254551 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:13.255972 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:13.256309 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:13.256312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:13.256313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:13.256382 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:13.256623 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:13.256625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:13.256626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:13.256767 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:13.256861 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:13.257054 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 18:43:13.257142 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:43:13.258384 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11056
I20260807 18:43:13.265282 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11195
I20260807 18:43:13.271775 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11331
I20260807 18:43:13.277381 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 10959
2026-08-07T18:43:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2284 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[11482](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[11482](info): set up 2 sockets
Aug 07 18:43:13 dist-test-slave-07c2 krb5kdc[11482](info): commencing operation
krb5kdc: starting...
W20260807 18:43:14.313606 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:14 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:14.429987 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42599
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:42599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:14.538287 11495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:14.538553 11495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:14.538611 11495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:14.542508 11495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:14.542575 11495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:14.542595 11495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:14.542611 11495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:14.542626 11495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:14.547791 11495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:42599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:14.549281 11495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:14.550330 11495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:14.558595 11501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:14.558595 11500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:14.558620 11503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:14.558852 11495 server_base.cc:1034] running on GCE node
I20260807 18:43:14.559585 11495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:14.560688 11495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:14.561874 11495 hybrid_clock.cc:648] HybridClock initialized: now 1786128194561861 us; error 27 us; skew 500 ppm
Aug 07 18:43:14 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:14.564668 11495 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:14.565614 11495 webserver.cc:460] Webserver started at http://127.10.174.254:45571/ using document root <none> and password file <none>
I20260807 18:43:14.566175 11495 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:14.566282 11495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:14.566515 11495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:14.568883 11495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "471474c8378c4f7a9e707e36fe6dcb1d"
format_stamp: "Formatted at 2026-08-07 18:43:14 on dist-test-slave-07c2"
server_key: "bbc68232939a778174742a3d9103630c"
server_key_iv: "97879e15cc1496fc5c48e1951af9c12b"
server_key_version: "encryptionkey@0"
I20260807 18:43:14.569483 11495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "471474c8378c4f7a9e707e36fe6dcb1d"
format_stamp: "Formatted at 2026-08-07 18:43:14 on dist-test-slave-07c2"
server_key: "bbc68232939a778174742a3d9103630c"
server_key_iv: "97879e15cc1496fc5c48e1951af9c12b"
server_key_version: "encryptionkey@0"
I20260807 18:43:14.573356 11495 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:43:14.575783 11511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:14.576925 11495 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:14.577081 11495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "471474c8378c4f7a9e707e36fe6dcb1d"
format_stamp: "Formatted at 2026-08-07 18:43:14 on dist-test-slave-07c2"
server_key: "bbc68232939a778174742a3d9103630c"
server_key_iv: "97879e15cc1496fc5c48e1951af9c12b"
server_key_version: "encryptionkey@0"
I20260807 18:43:14.577193 11495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:14.587735 11495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:14.590566 11495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:14.590775 11495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:14.597808 11495 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:42599
I20260807 18:43:14.597834 11565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:42599 every 8 connection(s)
I20260807 18:43:14.598685 11495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:14.601416 11566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:14.605962 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11495
I20260807 18:43:14.606055 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:14.606308 10939 external_mini_cluster.cc:1428] Setting key 91eca818b9b05dab5e5e0017bb294926
I20260807 18:43:14.607095 11566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d: Bootstrap starting.
I20260807 18:43:14.609262 11566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:14.610185 11566 log.cc:824] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:14.612298 11566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d: No bootstrap required, opened a new log
Aug 07 18:43:14 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:14.617198 11566 raft_consensus.cc:348] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42599 } }
I20260807 18:43:14.617414 11566 raft_consensus.cc:374] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:14.617476 11566 raft_consensus.cc:729] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471474c8378c4f7a9e707e36fe6dcb1d, State: Initialized, Role: FOLLOWER
I20260807 18:43:14.617966 11566 consensus_queue.cc:260] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42599 } }
I20260807 18:43:14.618122 11566 raft_consensus.cc:388] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:14.618211 11566 raft_consensus.cc:482] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:14.618333 11566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:14.619428 11566 raft_consensus.cc:504] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42599 } }
I20260807 18:43:14.619830 11566 leader_election.cc:302] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 471474c8378c4f7a9e707e36fe6dcb1d; no voters:
I20260807 18:43:14.620216 11566 leader_election.cc:288] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:14.620286 11572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:14.620503 11572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [term 1 LEADER]: Becoming Leader. State: Replica: 471474c8378c4f7a9e707e36fe6dcb1d, State: Running, Role: LEADER
I20260807 18:43:14.620811 11572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42599 } }
I20260807 18:43:14.621022 11569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:14.607783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46042 (local address 127.10.174.254:42599)
0807 18:43:14.608181 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:14.608198 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:14.608243 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:43:14.608855 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:14.608869 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:14.609167 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:14.609494 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:14.610395 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:14.611437 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:14.612536 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:14.612994 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:14.613109 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:14.615970 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:14.615975 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:14.615987 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:14.616013 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:14.617783 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:14.618264 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:14.618269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:14.618277 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:14.618457 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:14.618776 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:14.618778 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:14.618779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:14.619157 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:14.619360 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:14.619705 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 18:43:14.620022 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":142,"threads_started":1}
I20260807 18:43:14.621502 11566 sys_catalog.cc:564] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:14.622511 11573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 471474c8378c4f7a9e707e36fe6dcb1d. Latest consensus state: current_term: 1 leader_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42599 } } }
I20260807 18:43:14.622671 11573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:14.623036 11574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471474c8378c4f7a9e707e36fe6dcb1d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42599 } } }
I20260807 18:43:14.623123 11574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:14.623356 11582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:14.626323 11582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:14.632265 11582 catalog_manager.cc:1347] Generated new cluster ID: a77039862ff84ae48b86a76663ccc0d6
I20260807 18:43:14.632344 11582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:14.659258 11582 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:14.660234 11582 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:14.668881 11582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 471474c8378c4f7a9e707e36fe6dcb1d: Generated new TSK 0
I20260807 18:43:14.669515 11582 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:14.700309 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42599
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:14.808636 11594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:14.808869 11594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:14.808911 11594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:14.812763 11594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:14.812806 11594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:14.812861 11594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:14.817827 11594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42599
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:14.818676 11594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:14.819587 11594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:14.828692 11603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:14.828701 11599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:14.828934 11594 server_base.cc:1034] running on GCE node
W20260807 18:43:14.829013 11600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:14.829384 11594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:14.829892 11594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:14.831089 11594 hybrid_clock.cc:648] HybridClock initialized: now 1786128194831069 us; error 31 us; skew 500 ppm
Aug 07 18:43:14 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:14.833704 11594 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:14.834527 11594 webserver.cc:460] Webserver started at http://127.10.174.193:37549/ using document root <none> and password file <none>
I20260807 18:43:14.834995 11594 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:14.835052 11594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:14.835202 11594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:14.837152 11594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "eef9c3c1d10842fc88bcbf787cba1fd3"
format_stamp: "Formatted at 2026-08-07 18:43:14 on dist-test-slave-07c2"
server_key: "6d146c8c76f90794497d9468f8e55ff9"
server_key_iv: "99e180cae300dfca6504ec280f3f4f70"
server_key_version: "encryptionkey@0"
I20260807 18:43:14.837638 11594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "eef9c3c1d10842fc88bcbf787cba1fd3"
format_stamp: "Formatted at 2026-08-07 18:43:14 on dist-test-slave-07c2"
server_key: "6d146c8c76f90794497d9468f8e55ff9"
server_key_iv: "99e180cae300dfca6504ec280f3f4f70"
server_key_version: "encryptionkey@0"
I20260807 18:43:14.841045 11594 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:14.843448 11610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:14.844612 11594 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:14.844743 11594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "eef9c3c1d10842fc88bcbf787cba1fd3"
format_stamp: "Formatted at 2026-08-07 18:43:14 on dist-test-slave-07c2"
server_key: "6d146c8c76f90794497d9468f8e55ff9"
server_key_iv: "99e180cae300dfca6504ec280f3f4f70"
server_key_version: "encryptionkey@0"
I20260807 18:43:14.844861 11594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:14.866258 11594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:14.868919 11594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:14.869115 11594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:14.869664 11594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:14.870440 11594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:14.870507 11594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:14.870579 11594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:14.870621 11594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:14.879364 11594 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:33889
I20260807 18:43:14.879395 11727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:33889 every 8 connection(s)
I20260807 18:43:14.880198 11594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:14.886348 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11594
I20260807 18:43:14.886432 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:14.886672 10939 external_mini_cluster.cc:1428] Setting key 473e46a65cd32dbe6357be42d2cf75d3
Aug 07 18:43:14 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128194, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:14.893155 11569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:14.881948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:60913 (local address 127.10.174.254:42599)
0807 18:43:14.882078 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:14.882081 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:14.882873 (+ 792us) server_negotiation.cc:407] Connection header received
0807 18:43:14.883837 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:14.883841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:14.883900 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:14.884001 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:14.885099 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:14.885622 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:14.886861 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:14.887165 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:14.887313 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:14.889723 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:14.889726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:14.889728 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:14.889756 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:14.891149 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:14.891687 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:14.891696 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:14.891697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:14.891776 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:14.892113 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:14.892117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:14.892119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:14.892296 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:14.892403 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:14.892864 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 18:43:14.892988 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:14.893878 11730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:14.882311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42599 (local address 127.10.174.193:60913)
0807 18:43:14.882734 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:14.882775 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:14.883633 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:14.884176 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:14.884182 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:14.884506 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:14.884946 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:14.884959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:14.885757 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:14.885761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:14.886722 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:14.886737 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:14.887359 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:14.887363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:14.887529 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:14.888136 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:14.888152 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:14.889548 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:14.891279 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:14.891304 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:14.891317 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:14.891572 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:14.891870 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:14.891874 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:14.891876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:14.892011 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:14.892402 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:14.892409 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:14.892637 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 18:43:14.892809 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 18:43:14.893100 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":98,"threads_started":1}
I20260807 18:43:14.895092 11728 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42599
I20260807 18:43:14.895359 11728 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:14.895956 11728 heartbeater.cc:511] Master 127.10.174.254:42599 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:14.897451 11528 ts_manager.cc:194] Registered new tserver with Master: eef9c3c1d10842fc88bcbf787cba1fd3 (127.10.174.193:33889)
I20260807 18:43:14.898499 11528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:60913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:14.911962 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42599
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:15.020370 11733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:15.020609 11733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:15.020653 11733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:15.024950 11733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:15.025017 11733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:15.025099 11733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:15.030352 11733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42599
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:15.031323 11733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:15.032285 11733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:15.042081 11738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:15.042096 11743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:15.042080 11741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:15.042464 11733 server_base.cc:1034] running on GCE node
I20260807 18:43:15.042889 11733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:15.043506 11733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:15.044677 11733 hybrid_clock.cc:648] HybridClock initialized: now 1786128195044649 us; error 25 us; skew 500 ppm
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:15.047272 11733 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:15.048183 11733 webserver.cc:460] Webserver started at http://127.10.174.194:44843/ using document root <none> and password file <none>
I20260807 18:43:15.048732 11733 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:15.048794 11733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:15.049026 11733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:15.050976 11733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "66e4884906584c98aa1d9f800ed664b9"
format_stamp: "Formatted at 2026-08-07 18:43:15 on dist-test-slave-07c2"
server_key: "2b9e5efa9df05ae7f4a7e55485e349a7"
server_key_iv: "7b122d07ef65a8a12c23999f904cdc59"
server_key_version: "encryptionkey@0"
I20260807 18:43:15.051543 11733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "66e4884906584c98aa1d9f800ed664b9"
format_stamp: "Formatted at 2026-08-07 18:43:15 on dist-test-slave-07c2"
server_key: "2b9e5efa9df05ae7f4a7e55485e349a7"
server_key_iv: "7b122d07ef65a8a12c23999f904cdc59"
server_key_version: "encryptionkey@0"
I20260807 18:43:15.055029 11733 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 18:43:15.057462 11750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:15.058589 11733 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 18:43:15.058723 11733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "66e4884906584c98aa1d9f800ed664b9"
format_stamp: "Formatted at 2026-08-07 18:43:15 on dist-test-slave-07c2"
server_key: "2b9e5efa9df05ae7f4a7e55485e349a7"
server_key_iv: "7b122d07ef65a8a12c23999f904cdc59"
server_key_version: "encryptionkey@0"
I20260807 18:43:15.058820 11733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:15.076308 11733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:15.078967 11733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:15.079162 11733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:15.079751 11733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:15.080596 11733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:15.080643 11733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:15.080729 11733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:15.080766 11733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:15.089615 11733 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:42911
I20260807 18:43:15.089645 11866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:42911 every 8 connection(s)
I20260807 18:43:15.090451 11733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:15.097942 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11733
I20260807 18:43:15.098089 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:15.098385 10939 external_mini_cluster.cc:1428] Setting key 01b474d0b7da70cdde8dcf7eafc9638d
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:15.103987 11569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.092194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:43191 (local address 127.10.174.254:42599)
0807 18:43:15.092338 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.092342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.093185 (+ 843us) server_negotiation.cc:407] Connection header received
0807 18:43:15.094061 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.094064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.094121 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.094225 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:15.095331 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.095852 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.096956 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.097175 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.097287 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.100065 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:15.100069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:15.100072 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:15.100098 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:15.101753 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.102394 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.102398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.102400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.102501 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.102873 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.102877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.102878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.103055 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:15.103170 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.103692 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.103820 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:43:15.104892 11869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.092557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42599 (local address 127.10.174.194:43191)
0807 18:43:15.093048 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.093089 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.093865 (+ 776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.094391 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.094397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.094730 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:15.095162 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.095174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.095982 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.095990 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.096830 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.096839 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.097325 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.097329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.097492 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.098122 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:15.098162 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:15.099886 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:15.101869 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:15.101874 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:15.101885 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:15.102285 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:15.102598 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:15.102602 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:15.102604 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:15.102763 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:15.103164 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:15.103170 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:15.103458 (+ 288us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.103646 (+ 188us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.103958 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":130,"threads_started":1}
I20260807 18:43:15.106009 11867 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42599
I20260807 18:43:15.106273 11867 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:15.106868 11867 heartbeater.cc:511] Master 127.10.174.254:42599 requested a full tablet report, sending...
I20260807 18:43:15.108083 11528 ts_manager.cc:194] Registered new tserver with Master: 66e4884906584c98aa1d9f800ed664b9 (127.10.174.194:42911)
I20260807 18:43:15.108922 11528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:43191
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:15.124202 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42599
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:15.231760 11872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:15.232008 11872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:15.232053 11872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:15.236056 11872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:15.236111 11872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:15.236207 11872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:15.241708 11872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42599
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:15.242774 11872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:15.243834 11872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:43:15.253414 11872 server_base.cc:1034] running on GCE node
W20260807 18:43:15.253366 11878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:15.253366 11879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:15.253417 11881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:15.253958 11872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:15.254595 11872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:15.255752 11872 hybrid_clock.cc:648] HybridClock initialized: now 1786128195255740 us; error 25 us; skew 500 ppm
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:15.258455 11872 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:15.259449 11872 webserver.cc:460] Webserver started at http://127.10.174.195:39051/ using document root <none> and password file <none>
I20260807 18:43:15.259972 11872 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:15.260030 11872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:15.260192 11872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:15.262238 11872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "79eeab77e2da4545875b13c2f680ffee"
format_stamp: "Formatted at 2026-08-07 18:43:15 on dist-test-slave-07c2"
server_key: "a6c03f59b3f9ca2cc3a6ba5bf368fd6b"
server_key_iv: "6a697353981b92ae90c72f7462cd42f0"
server_key_version: "encryptionkey@0"
I20260807 18:43:15.262807 11872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "79eeab77e2da4545875b13c2f680ffee"
format_stamp: "Formatted at 2026-08-07 18:43:15 on dist-test-slave-07c2"
server_key: "a6c03f59b3f9ca2cc3a6ba5bf368fd6b"
server_key_iv: "6a697353981b92ae90c72f7462cd42f0"
server_key_version: "encryptionkey@0"
I20260807 18:43:15.266480 11872 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 18:43:15.268921 11889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:15.270134 11872 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:15.270275 11872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "79eeab77e2da4545875b13c2f680ffee"
format_stamp: "Formatted at 2026-08-07 18:43:15 on dist-test-slave-07c2"
server_key: "a6c03f59b3f9ca2cc3a6ba5bf368fd6b"
server_key_iv: "6a697353981b92ae90c72f7462cd42f0"
server_key_version: "encryptionkey@0"
I20260807 18:43:15.270388 11872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:15.285727 11872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:15.288615 11872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:15.288821 11872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:15.289415 11872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:15.290220 11872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:15.290298 11872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:15.290369 11872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:15.290413 11872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:15.299497 11872 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:42027
I20260807 18:43:15.299561 12005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:42027 every 8 connection(s)
I20260807 18:43:15.300447 11872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:15.310061 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 11872
I20260807 18:43:15.310202 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:15.310587 10939 external_mini_cluster.cc:1428] Setting key 8cea157399d3e006e98c9071d942d741
I20260807 18:43:15.313710 11569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.302157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:35119 (local address 127.10.174.254:42599)
0807 18:43:15.302299 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.302303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.303090 (+ 787us) server_negotiation.cc:407] Connection header received
0807 18:43:15.304036 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.304040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.304098 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.304192 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:15.305305 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.305850 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.307006 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.307250 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.307413 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.309925 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:15.309933 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:15.309935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:15.309960 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:15.311626 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.312203 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.312206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.312207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.312291 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.312685 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.312690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.312694 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.312945 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:15.313037 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.313497 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.313591 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 18:43:15.314586 12008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.302508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42599 (local address 127.10.174.195:35119)
0807 18:43:15.302948 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.302987 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.303833 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.304350 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.304357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.304713 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:15.305158 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.305173 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.305987 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.305990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.306871 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.306880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.307454 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.307458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.307629 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.308291 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:15.308307 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:15.309749 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:15.311731 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:15.311736 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:15.311747 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:15.312107 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:15.312384 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:15.312387 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:15.312389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:15.312568 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:15.313056 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:15.313062 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:15.313295 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.313451 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.313717 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":116,"threads_started":1}
I20260807 18:43:15.315703 12006 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42599
I20260807 18:43:15.315945 12006 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:15.316439 12006 heartbeater.cc:511] Master 127.10.174.254:42599 requested a full tablet report, sending...
I20260807 18:43:15.317451 11528 ts_manager.cc:194] Registered new tserver with Master: 79eeab77e2da4545875b13c2f680ffee (127.10.174.195:42027)
I20260807 18:43:15.318027 11528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:35119
I20260807 18:43:15.324599 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:43:15.336512 11569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.328757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46048 (local address 127.10.174.254:42599)
0807 18:43:15.328930 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.328935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.329083 (+ 148us) server_negotiation.cc:407] Connection header received
0807 18:43:15.329240 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.329243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.329296 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.329381 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:15.330112 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.330629 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.331508 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.331733 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.331853 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.333271 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:15.333274 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:15.333277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:15.333308 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:15.334741 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.335172 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.335176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.335179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.335260 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.335595 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.335599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.335601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.335828 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:15.335972 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.336221 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.336343 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 18:43:15.342278 11528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:15.345734 11528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:15.360975 12020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.354830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54182 (local address 127.10.174.195:42027)
0807 18:43:15.355462 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.356451 (+ 989us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.356482 (+ 31us) server_negotiation.cc:407] Connection header received
0807 18:43:15.356562 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.356566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.356743 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.356904 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.357125 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.357924 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.359512 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.360192 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.360568 (+ 376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.360703 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.360754 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.360841 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":149,"threads_started":1}
I20260807 18:43:15.360966 12018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.354700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:42027 (local address 127.0.0.1:54182)
0807 18:43:15.355432 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.355481 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.355640 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.356893 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.356896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.356914 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.357007 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.357013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.358062 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.358066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.359370 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.359382 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.360338 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.360342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.360477 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.360567 (+ 90us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.360646 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.360815 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":106,"thread_start_us":84,"threads_started":1}
I20260807 18:43:15.361212 12022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.355552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42911 (local address 127.0.0.1:49732)
0807 18:43:15.356249 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.356263 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.356351 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.357072 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.357077 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.357096 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.357187 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.357193 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.358574 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.358577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.359706 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.359716 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.360769 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.360773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.360856 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.360877 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.360955 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.361029 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":110,"threads_started":1}
I20260807 18:43:15.361588 12021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.355004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56616 (local address 127.10.174.193:33889)
0807 18:43:15.355784 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.355802 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.355827 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:43:15.355933 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.355938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.356151 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.356342 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.356668 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.357775 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.359435 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.360155 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.360290 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.360481 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.361361 (+ 880us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.361455 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":56,"threads_started":1}
I20260807 18:43:15.361910 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.356061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.10.174.194:42911)
0807 18:43:15.356497 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.356510 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.356529 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:43:15.356590 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.356594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.356774 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.356904 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.357317 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.358422 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.359838 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.360647 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.360771 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.360882 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.360992 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.361629 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":135,"threads_started":1}
I20260807 18:43:15.362350 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.354829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33889 (local address 127.0.0.1:56616)
0807 18:43:15.355429 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.355478 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.355731 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.356371 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.356377 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.356403 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.356540 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.356547 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.357924 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.357929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.359250 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.359260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.360306 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.360313 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.360482 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.360545 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.360653 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.362229 (+ 1576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":104,"thread_start_us":105,"threads_started":1}
I20260807 18:43:15.364336 11798 tablet_service.cc:1467] Processing CreateTablet for tablet f85b3054970e4b698582244dea50897b (DEFAULT_TABLE table=test-table [id=13fffb85e8574eec9975acb3507f7e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:15.364260 11939 tablet_service.cc:1467] Processing CreateTablet for tablet f85b3054970e4b698582244dea50897b (DEFAULT_TABLE table=test-table [id=13fffb85e8574eec9975acb3507f7e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:15.365011 11659 tablet_service.cc:1467] Processing CreateTablet for tablet f85b3054970e4b698582244dea50897b (DEFAULT_TABLE table=test-table [id=13fffb85e8574eec9975acb3507f7e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:15.365494 11939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f85b3054970e4b698582244dea50897b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:15.365984 11659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f85b3054970e4b698582244dea50897b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:15.368001 11798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f85b3054970e4b698582244dea50897b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:15.372846 12024 tablet_bootstrap.cc:492] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: Bootstrap starting.
I20260807 18:43:15.374342 12026 tablet_bootstrap.cc:492] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3: Bootstrap starting.
I20260807 18:43:15.375334 12024 tablet_bootstrap.cc:654] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:15.375376 12025 tablet_bootstrap.cc:492] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9: Bootstrap starting.
I20260807 18:43:15.376726 12026 tablet_bootstrap.cc:654] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:15.376983 12024 log.cc:824] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:15.377899 12025 tablet_bootstrap.cc:654] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:15.377928 12026 log.cc:824] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:15.378618 12025 log.cc:824] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:15.378852 12024 tablet_bootstrap.cc:492] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: No bootstrap required, opened a new log
I20260807 18:43:15.379050 12024 ts_tablet_manager.cc:1397] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:43:15.379899 12026 tablet_bootstrap.cc:492] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3: No bootstrap required, opened a new log
I20260807 18:43:15.380093 12026 ts_tablet_manager.cc:1397] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260807 18:43:15.380719 12025 tablet_bootstrap.cc:492] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9: No bootstrap required, opened a new log
I20260807 18:43:15.380920 12025 ts_tablet_manager.cc:1397] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260807 18:43:15.382361 12024 raft_consensus.cc:348] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.382627 12024 raft_consensus.cc:374] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:15.382690 12024 raft_consensus.cc:729] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79eeab77e2da4545875b13c2f680ffee, State: Initialized, Role: FOLLOWER
I20260807 18:43:15.383170 12024 consensus_queue.cc:260] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.383930 12006 heartbeater.cc:503] Master 127.10.174.254:42599 was elected leader, sending a full tablet report...
I20260807 18:43:15.384022 12026 raft_consensus.cc:348] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.384223 12024 ts_tablet_manager.cc:1428] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:43:15.384241 12026 raft_consensus.cc:374] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:15.384286 12026 raft_consensus.cc:729] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef9c3c1d10842fc88bcbf787cba1fd3, State: Initialized, Role: FOLLOWER
I20260807 18:43:15.384776 12026 consensus_queue.cc:260] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.385201 12025 raft_consensus.cc:348] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.385511 12025 raft_consensus.cc:374] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:15.385567 12025 raft_consensus.cc:729] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e4884906584c98aa1d9f800ed664b9, State: Initialized, Role: FOLLOWER
I20260807 18:43:15.385744 11728 heartbeater.cc:503] Master 127.10.174.254:42599 was elected leader, sending a full tablet report...
I20260807 18:43:15.385771 12026 ts_tablet_manager.cc:1428] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 18:43:15.386024 12025 consensus_queue.cc:260] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.386622 11867 heartbeater.cc:503] Master 127.10.174.254:42599 was elected leader, sending a full tablet report...
I20260807 18:43:15.388001 12025 ts_tablet_manager.cc:1428] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:43:15.452231 12032 raft_consensus.cc:482] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:15.452448 12032 raft_consensus.cc:504] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.453172 12031 raft_consensus.cc:482] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:15.453343 12031 raft_consensus.cc:504] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.453760 12032 leader_election.cc:288] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79eeab77e2da4545875b13c2f680ffee (127.10.174.195:42027), eef9c3c1d10842fc88bcbf787cba1fd3 (127.10.174.193:33889)
I20260807 18:43:15.455302 12031 leader_election.cc:288] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79eeab77e2da4545875b13c2f680ffee (127.10.174.195:42027), 66e4884906584c98aa1d9f800ed664b9 (127.10.174.194:42911)
I20260807 18:43:15.458602 11869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.453900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:42027 (local address 127.10.174.194:37311)
0807 18:43:15.454234 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.454249 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.454345 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.454775 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.454778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.454796 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.454960 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.454969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.455986 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.455989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.457215 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.457223 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.458161 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.458165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.458287 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.458310 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.458386 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.458466 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":34}
I20260807 18:43:15.459260 12020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.454075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:37311 (local address 127.10.174.195:42027)
0807 18:43:15.454227 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.454232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.454432 (+ 200us) server_negotiation.cc:407] Connection header received
0807 18:43:15.454496 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.454500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.454552 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.454621 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.455103 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.455866 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.457343 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.457947 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.458058 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.458105 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.458845 (+ 740us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.459129 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":191,"server-negotiator.queue_time_us":49}
I20260807 18:43:15.459695 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.455248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:51517 (local address 127.10.174.194:42911)
0807 18:43:15.455371 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.455376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.455579 (+ 203us) server_negotiation.cc:407] Connection header received
0807 18:43:15.455699 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.455702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.455740 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.455782 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.456271 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.456960 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.458438 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.459001 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.459083 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.459123 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.459521 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.459595 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:43:15.459717 12021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.454417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58325 (local address 127.10.174.193:33889)
0807 18:43:15.454542 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.454546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.454561 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:43:15.454609 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.454612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.454669 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.454772 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.455887 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.456721 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.458400 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.459014 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.459099 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.459148 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.459520 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.459586 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":47}
I20260807 18:43:15.459964 12034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.454568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:42027 (local address 127.10.174.193:55029)
0807 18:43:15.454984 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.455000 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.455075 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.455848 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.455853 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.455876 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.456024 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.456031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.457222 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.457226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.458425 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.458433 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.459420 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.459424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.459541 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.459559 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.459622 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.459678 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":104,"threads_started":1}
I20260807 18:43:15.459925 11959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "66e4884906584c98aa1d9f800ed664b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79eeab77e2da4545875b13c2f680ffee" is_pre_election: true
I20260807 18:43:15.460119 12036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.455059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42911 (local address 127.10.174.193:51517)
0807 18:43:15.455462 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.455477 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.455580 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.455899 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.455905 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.455929 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.456139 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.456147 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.457090 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.457093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.458313 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.458322 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.459231 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.459234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.459362 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.459385 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.459810 (+ 425us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.459919 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":54,"thread_start_us":104,"threads_started":1}
I20260807 18:43:15.460114 12035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.454897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:55029 (local address 127.10.174.195:42027)
0807 18:43:15.455579 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.455589 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.455602 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:43:15.455645 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.455648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.455686 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.456128 (+ 442us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:15.456231 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.457050 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.458557 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.459266 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.459823 (+ 557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.459875 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.459912 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.459972 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":594,"thread_start_us":124,"threads_started":1}
I20260807 18:43:15.460340 11959 raft_consensus.cc:2454] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e4884906584c98aa1d9f800ed664b9 in term 0.
I20260807 18:43:15.460409 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.454034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33889 (local address 127.10.174.194:58325)
0807 18:43:15.454428 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:15.454442 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:15.454522 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:15.454788 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:15.454790 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:15.454800 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:15.455760 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.455772 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.456850 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.456853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.458261 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:15.458271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.459247 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.459250 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:15.459387 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.459411 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:43:15.460187 (+ 776us) client_negotiation.cc:240] Negotiation successful
0807 18:43:15.460274 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":7,"thread_start_us":152,"threads_started":1}
I20260807 18:43:15.460611 11818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e4884906584c98aa1d9f800ed664b9" is_pre_election: true
I20260807 18:43:15.460863 11751 leader_election.cc:302] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e4884906584c98aa1d9f800ed664b9, 79eeab77e2da4545875b13c2f680ffee; no voters:
I20260807 18:43:15.460970 11679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "66e4884906584c98aa1d9f800ed664b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" is_pre_election: true
I20260807 18:43:15.461022 11958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79eeab77e2da4545875b13c2f680ffee" is_pre_election: true
I20260807 18:43:15.461123 11958 raft_consensus.cc:2454] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9c3c1d10842fc88bcbf787cba1fd3 in term 0.
I20260807 18:43:15.460829 11818 raft_consensus.cc:2454] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eef9c3c1d10842fc88bcbf787cba1fd3 in term 0.
I20260807 18:43:15.461144 11679 raft_consensus.cc:2454] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e4884906584c98aa1d9f800ed664b9 in term 0.
I20260807 18:43:15.461460 12032 raft_consensus.cc:2781] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:15.461506 11611 leader_election.cc:302] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79eeab77e2da4545875b13c2f680ffee, eef9c3c1d10842fc88bcbf787cba1fd3; no voters:
I20260807 18:43:15.461551 12032 raft_consensus.cc:482] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:15.461612 12032 raft_consensus.cc:3037] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:15.461774 12031 raft_consensus.cc:2781] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:15.461859 12031 raft_consensus.cc:482] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:15.461923 12031 raft_consensus.cc:3037] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:15.462879 12032 raft_consensus.cc:504] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.463061 12031 raft_consensus.cc:504] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.463480 12031 leader_election.cc:288] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [CANDIDATE]: Term 1 election: Requested vote from peers 79eeab77e2da4545875b13c2f680ffee (127.10.174.195:42027), 66e4884906584c98aa1d9f800ed664b9 (127.10.174.194:42911)
I20260807 18:43:15.463568 11958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "66e4884906584c98aa1d9f800ed664b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79eeab77e2da4545875b13c2f680ffee"
I20260807 18:43:15.463681 11958 raft_consensus.cc:3037] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:15.463871 11679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "66e4884906584c98aa1d9f800ed664b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3"
I20260807 18:43:15.464090 11679 raft_consensus.cc:2379] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e4884906584c98aa1d9f800ed664b9 in current term 1: Already voted for candidate eef9c3c1d10842fc88bcbf787cba1fd3 in this term.
I20260807 18:43:15.464083 11818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e4884906584c98aa1d9f800ed664b9"
I20260807 18:43:15.464438 11818 raft_consensus.cc:2379] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eef9c3c1d10842fc88bcbf787cba1fd3 in current term 1: Already voted for candidate 66e4884906584c98aa1d9f800ed664b9 in this term.
I20260807 18:43:15.464521 12032 leader_election.cc:288] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [CANDIDATE]: Term 1 election: Requested vote from peers 79eeab77e2da4545875b13c2f680ffee (127.10.174.195:42027), eef9c3c1d10842fc88bcbf787cba1fd3 (127.10.174.193:33889)
I20260807 18:43:15.464744 11959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f85b3054970e4b698582244dea50897b" candidate_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79eeab77e2da4545875b13c2f680ffee"
I20260807 18:43:15.465242 11958 raft_consensus.cc:2454] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e4884906584c98aa1d9f800ed664b9 in term 1.
I20260807 18:43:15.465467 11613 leader_election.cc:302] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eef9c3c1d10842fc88bcbf787cba1fd3; no voters: 66e4884906584c98aa1d9f800ed664b9, 79eeab77e2da4545875b13c2f680ffee
I20260807 18:43:15.465529 11751 leader_election.cc:302] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e4884906584c98aa1d9f800ed664b9, 79eeab77e2da4545875b13c2f680ffee; no voters: eef9c3c1d10842fc88bcbf787cba1fd3
I20260807 18:43:15.465644 12031 raft_consensus.cc:2726] T f85b3054970e4b698582244dea50897b P eef9c3c1d10842fc88bcbf787cba1fd3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 18:43:15.465773 12032 raft_consensus.cc:2781] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:15.465978 12032 raft_consensus.cc:686] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [term 1 LEADER]: Becoming Leader. State: Replica: 66e4884906584c98aa1d9f800ed664b9, State: Running, Role: LEADER
I20260807 18:43:15.466277 12032 consensus_queue.cc:237] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } }
I20260807 18:43:15.469769 11526 catalog_manager.cc:5495] T f85b3054970e4b698582244dea50897b P 66e4884906584c98aa1d9f800ed664b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e4884906584c98aa1d9f800ed664b9 (127.10.174.194). New cstate: current_term: 1 leader_uuid: "66e4884906584c98aa1d9f800ed664b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79eeab77e2da4545875b13c2f680ffee" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 42027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eef9c3c1d10842fc88bcbf787cba1fd3" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e4884906584c98aa1d9f800ed664b9" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42911 } health_report { overall_health: HEALTHY } } }
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:15.482862 12021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.473765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56626 (local address 127.10.174.193:33889)
0807 18:43:15.473880 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.473884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.474098 (+ 214us) server_negotiation.cc:407] Connection header received
0807 18:43:15.474246 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.474249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.474291 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.474377 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:15.475042 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.475602 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.476444 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.476724 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.476828 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.479341 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:15.479354 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:15.479372 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:15.479393 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:15.481112 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.481553 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.481558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.481559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.481691 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.481969 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.481974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.481975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.482209 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:15.482430 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.482586 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.482713 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:15.510569 12021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.501948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56636 (local address 127.10.174.193:33889)
0807 18:43:15.502099 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.502103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.502248 (+ 145us) server_negotiation.cc:407] Connection header received
0807 18:43:15.502400 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.502403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.502447 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.502526 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:15.503147 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.503782 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.504597 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.504845 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.504950 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.507382 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:15.507385 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:15.507388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:15.507418 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:15.508945 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.509362 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.509366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.509367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.509447 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.509718 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.509722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.509724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.509880 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:15.510012 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.510296 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.510413 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[11482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:15.535698 12021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:15.527561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56640 (local address 127.10.174.193:33889)
0807 18:43:15.527709 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:15.527714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:15.527854 (+ 140us) server_negotiation.cc:407] Connection header received
0807 18:43:15.528004 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:15.528007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:15.528054 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:15.528136 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:15.528784 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.529269 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.530075 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:15.530292 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:15.530397 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:15.532695 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:15.532699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:15.532701 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:15.532726 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:15.534090 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.534498 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.534502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.534505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.534583 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:15.534865 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:15.534868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:15.534870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:15.535023 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:15.535200 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:15.535421 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 18:43:15.535530 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 18:43:15.537146 11639 tablet_service.cc:2908] Rejecting scan request for tablet f85b3054970e4b698582244dea50897b: Uninitialized: clean time has not yet been initialized
I20260807 18:43:15.539156 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11594
I20260807 18:43:15.546425 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11733
W20260807 18:43:15.551399 12007 tablet.cc:2369] T f85b3054970e4b698582244dea50897b P 79eeab77e2da4545875b13c2f680ffee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:15.552723 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11872
I20260807 18:43:15.558804 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 11495
2026-08-07T18:43:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2282 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[12052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[12052](info): set up 2 sockets
Aug 07 18:43:15 dist-test-slave-07c2 krb5kdc[12052](info): commencing operation
krb5kdc: starting...
W20260807 18:43:16.617713 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:16 dist-test-slave-07c2 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:16.742216 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38747
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:16.848464 12066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:16.848754 12066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:16.848832 12066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:16.852720 12066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:16.852808 12066 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 18:43:16.852841 12066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:16.852883 12066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:16.852918 12066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:16.852967 12066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:16.858033 12066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38747
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:16.859015 12066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:16.860004 12066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:16.868100 12071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:16.868235 12066 server_base.cc:1034] running on GCE node
W20260807 18:43:16.868105 12072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:16.868410 12074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:16.868944 12066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:16.869992 12066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:16.871181 12066 hybrid_clock.cc:648] HybridClock initialized: now 1786128196871167 us; error 35 us; skew 500 ppm
Aug 07 18:43:16 dist-test-slave-07c2 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128196, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:16.873895 12066 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:16.874719 12066 webserver.cc:460] Webserver started at http://127.10.174.254:44561/ using document root <none> and password file <none>
I20260807 18:43:16.875257 12066 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:16.875378 12066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:16.875600 12066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:16.877555 12066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "9d734ea47f874a63acd07a54d364b591"
format_stamp: "Formatted at 2026-08-07 18:43:16 on dist-test-slave-07c2"
server_key: "477ffbefbf969529f9239f8a23824b7a"
server_key_iv: "43ce1698aad8b5825159fdd8e3dc140c"
server_key_version: "encryptionkey@0"
I20260807 18:43:16.878115 12066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "9d734ea47f874a63acd07a54d364b591"
format_stamp: "Formatted at 2026-08-07 18:43:16 on dist-test-slave-07c2"
server_key: "477ffbefbf969529f9239f8a23824b7a"
server_key_iv: "43ce1698aad8b5825159fdd8e3dc140c"
server_key_version: "encryptionkey@0"
I20260807 18:43:16.881731 12066 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:16.884064 12081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:16.885159 12066 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:16.885298 12066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "9d734ea47f874a63acd07a54d364b591"
format_stamp: "Formatted at 2026-08-07 18:43:16 on dist-test-slave-07c2"
server_key: "477ffbefbf969529f9239f8a23824b7a"
server_key_iv: "43ce1698aad8b5825159fdd8e3dc140c"
server_key_version: "encryptionkey@0"
I20260807 18:43:16.885406 12066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:16.933359 12066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:16.936853 12066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:16.937076 12066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:16.945068 12066 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38747
I20260807 18:43:16.945108 12145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38747 every 8 connection(s)
I20260807 18:43:16.945976 12066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:16.948557 12146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:16.948904 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12066
I20260807 18:43:16.948998 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:16.949268 10939 external_mini_cluster.cc:1428] Setting key 6d55d1c595bcbf03d309b5a009a86150
I20260807 18:43:16.955392 12146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: Bootstrap starting.
I20260807 18:43:16.957573 12146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: Neither blocks nor log segments found. Creating new log.
Aug 07 18:43:16 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:16.958436 12146 log.cc:824] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:16.960438 12146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: No bootstrap required, opened a new log
I20260807 18:43:16.963771 12146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d734ea47f874a63acd07a54d364b591" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38747 } }
I20260807 18:43:16.963961 12146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:16.964018 12146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d734ea47f874a63acd07a54d364b591, State: Initialized, Role: FOLLOWER
I20260807 18:43:16.964100 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:16.950598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.10.174.254:38747)
0807 18:43:16.951011 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:16.951028 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:16.951069 (+ 41us) server_negotiation.cc:407] Connection header received
0807 18:43:16.951818 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:16.951840 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:16.952224 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:16.952572 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:16.953194 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:16.954671 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:16.955573 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:16.956035 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:16.956209 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:16.958842 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:16.958848 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:16.958863 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:16.958895 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:16.961335 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:16.961832 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:16.961836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:16.961840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:16.961944 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:16.962236 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:16.962238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:16.962239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:16.962574 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:16.962741 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:16.962996 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 18:43:16.963283 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
I20260807 18:43:16.964486 12146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d734ea47f874a63acd07a54d364b591" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38747 } }
I20260807 18:43:16.964637 12146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:16.964725 12146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:16.964841 12146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:16.965905 12146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d734ea47f874a63acd07a54d364b591" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38747 } }
I20260807 18:43:16.966233 12146 leader_election.cc:302] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d734ea47f874a63acd07a54d364b591; no voters:
I20260807 18:43:16.966596 12146 leader_election.cc:288] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:16.966687 12152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:16.966914 12152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [term 1 LEADER]: Becoming Leader. State: Replica: 9d734ea47f874a63acd07a54d364b591, State: Running, Role: LEADER
I20260807 18:43:16.967203 12152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d734ea47f874a63acd07a54d364b591" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38747 } }
I20260807 18:43:16.967836 12146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:16.969875 12153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d734ea47f874a63acd07a54d364b591" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d734ea47f874a63acd07a54d364b591" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38747 } } }
I20260807 18:43:16.970000 12153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:16.970295 12154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d734ea47f874a63acd07a54d364b591. Latest consensus state: current_term: 1 leader_uuid: "9d734ea47f874a63acd07a54d364b591" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d734ea47f874a63acd07a54d364b591" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38747 } } }
I20260807 18:43:16.970474 12154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591 [sys.catalog]: This master's current role is: LEADER
W20260807 18:43:16.972570 12167 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:16.972633 12167 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:16.972743 12168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:16.973443 12168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:16.978585 12168 catalog_manager.cc:1347] Generated new cluster ID: 28c26faa132b433bb3d29134fc1d4c48
I20260807 18:43:16.978644 12168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:16.984833 12168 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:16.985994 12168 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:16.995718 12168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: Generated new TSK 0
I20260807 18:43:16.996465 12168 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:17.024032 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38747
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:17.134644 12173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:17.134899 12173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:17.134944 12173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:17.139051 12173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:17.139111 12173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:17.139151 12173 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:17.139215 12173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:17.144526 12173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:38747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:17.145558 12173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:17.146610 12173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:17.156001 12178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:17.156059 12182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:17.156028 12179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:17.156184 12173 server_base.cc:1034] running on GCE node
I20260807 18:43:17.156780 12173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:17.157357 12173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:17.158545 12173 hybrid_clock.cc:648] HybridClock initialized: now 1786128197158533 us; error 23 us; skew 500 ppm
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:17.161350 12173 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:17.162137 12173 webserver.cc:460] Webserver started at http://127.10.174.193:46825/ using document root <none> and password file <none>
I20260807 18:43:17.162670 12173 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:17.162729 12173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:17.162957 12173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:17.164947 12173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "fdd425f2020841159fde44b33128d0a1"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "ad203818174a7444ba95051deb9e46c8"
server_key_iv: "bec1c4a888b1742d8830da76b2403b49"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.165505 12173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "fdd425f2020841159fde44b33128d0a1"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "ad203818174a7444ba95051deb9e46c8"
server_key_iv: "bec1c4a888b1742d8830da76b2403b49"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.169137 12173 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:17.171439 12191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:17.172525 12173 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:17.172642 12173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "fdd425f2020841159fde44b33128d0a1"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "ad203818174a7444ba95051deb9e46c8"
server_key_iv: "bec1c4a888b1742d8830da76b2403b49"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.172741 12173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:17.188287 12173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:17.191107 12173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:17.191323 12173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:17.192667 12173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:17.192739 12173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:17.192804 12173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:17.192848 12173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:17.204103 12173 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:33897
I20260807 18:43:17.204173 12313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:33897 every 8 connection(s)
I20260807 18:43:17.205193 12173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:17.206801 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.193467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43403 (local address 127.10.174.254:38747)
0807 18:43:17.193593 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.193597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.194620 (+ 1023us) server_negotiation.cc:407] Connection header received
0807 18:43:17.195646 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.195650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.195705 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.195761 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.197108 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.198026 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.199217 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.199668 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.199797 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.202786 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.202790 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.202793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.202821 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.204648 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.205147 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.205154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.205158 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.205263 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.205684 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.205688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.205689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.205920 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.206024 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.206543 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.206674 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 18:43:17.207700 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.193980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.10.174.193:43403)
0807 18:43:17.194468 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.194507 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.195394 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.196204 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.196212 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.196522 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:17.196947 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.196960 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.198172 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.198178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.199111 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.199121 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.199869 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.199874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.200077 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.200666 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:17.200688 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:17.202578 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:17.204767 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.204772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.204782 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.205022 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.205383 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.205386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.205388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.205567 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.206098 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:17.206103 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:17.206315 (+ 212us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.206470 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.206712 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":136,"threads_started":1}
I20260807 18:43:17.209057 12314 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38747
I20260807 18:43:17.209275 12314 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:17.209759 12314 heartbeater.cc:511] Master 127.10.174.254:38747 requested a full tablet report, sending...
I20260807 18:43:17.210127 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12173
I20260807 18:43:17.210244 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:17.210566 10939 external_mini_cluster.cc:1428] Setting key 870a12323d605e6e90bf2f37c1b46ce2
I20260807 18:43:17.212302 12098 ts_manager.cc:194] Registered new tserver with Master: fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897)
I20260807 18:43:17.213444 12098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:43403
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:17.222285 12320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.211397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.10.174.193:37029)
0807 18:43:17.214605 (+ 3208us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x32ed1840. stack: 00007f81cc19ec78 00007f81cc19f1a9 00007f81cbd611d7 00000000005984a6 00000000005984f9 000000000059c488 00007f81d4906b35 00007f81cc1bf32b 00007f81cc1bfc82 00007f81cc1c13f1 000000000061d837 00007f81cc1b0511 00007f81cd7f86da 00007f81c8a6b61e
0807 18:43:17.214666 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.214678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.214815 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.215069 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.215072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.215349 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:17.215502 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.215513 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.216419 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.216427 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.217475 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.217488 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.217907 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.217913 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.218046 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.218566 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:17.218586 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:17.219054 (+ 468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:17.220779 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.220782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.220784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.221056 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.221333 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.221336 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.221338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.221424 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.221765 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:17.221768 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:17.221867 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.221999 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.222126 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"spinlock_wait_cycles":5750144,"thread_start_us":107,"threads_started":1}
I20260807 18:43:17.222458 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.211434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:37029 (local address 127.10.174.254:38747)
0807 18:43:17.211624 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.211628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.214759 (+ 3131us) server_negotiation.cc:407] Connection header received
0807 18:43:17.214919 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.214922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.214969 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.215054 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.215637 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.216242 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.217596 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.217806 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.217881 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.219204 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.219206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.219208 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.219229 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.220670 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.221150 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.221153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.221154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.221225 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.221503 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.221505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.221506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.221674 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.221748 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.222180 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.222276 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:17.238302 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38747
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:17.344610 12323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:17.344870 12323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:17.344915 12323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:17.348950 12323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:17.349001 12323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:17.349038 12323 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:17.349092 12323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:17.354188 12323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:38747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:17.355172 12323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:17.356171 12323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:17.365373 12328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:17.365361 12331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:17.365543 12323 server_base.cc:1034] running on GCE node
W20260807 18:43:17.365684 12329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:17.366044 12323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:17.366614 12323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:17.367769 12323 hybrid_clock.cc:648] HybridClock initialized: now 1786128197367752 us; error 32 us; skew 500 ppm
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:17.370581 12323 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:17.371448 12323 webserver.cc:460] Webserver started at http://127.10.174.194:44529/ using document root <none> and password file <none>
I20260807 18:43:17.371974 12323 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:17.372063 12323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:17.372298 12323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:17.374197 12323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "b731e844325049fe86065366c4c6da4e"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "b1921cb6b5cbbc6980543d61cdae1b3f"
server_key_iv: "55661183da606be3c9b527ab675a5e51"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.374763 12323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "b731e844325049fe86065366c4c6da4e"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "b1921cb6b5cbbc6980543d61cdae1b3f"
server_key_iv: "55661183da606be3c9b527ab675a5e51"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.378419 12323 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:17.380710 12338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:17.381794 12323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:17.381923 12323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "b731e844325049fe86065366c4c6da4e"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "b1921cb6b5cbbc6980543d61cdae1b3f"
server_key_iv: "55661183da606be3c9b527ab675a5e51"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.382026 12323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:17.416647 12323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:17.419545 12323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:17.419751 12323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:17.421232 12323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:17.421304 12323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:17.421378 12323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:17.421406 12323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:17.432575 12323 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:36473
I20260807 18:43:17.432657 12458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:36473 every 8 connection(s)
I20260807 18:43:17.433665 12323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:17.434278 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12323
I20260807 18:43:17.434391 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:17.434679 10939 external_mini_cluster.cc:1428] Setting key 9bb8369c9fe19643aa7e174be7843115
I20260807 18:43:17.435500 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.421912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:52725 (local address 127.10.174.254:38747)
0807 18:43:17.422051 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.422054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.423691 (+ 1637us) server_negotiation.cc:407] Connection header received
0807 18:43:17.424790 (+ 1099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.424793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.424856 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.424961 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.426247 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.426894 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.428165 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.428441 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.428573 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.431005 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.431008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.431010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.431034 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.432627 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.433171 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.433174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.433175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.433259 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.433610 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.433612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.433613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.433826 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.433901 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.435217 (+ 1316us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.435359 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 18:43:17.435714 12347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.422972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.10.174.194:52725)
0807 18:43:17.423549 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.423592 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.424576 (+ 984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.425129 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.425135 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.425546 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:17.426101 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.426115 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.427016 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.427020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.428041 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.428050 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.428620 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.428624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.428784 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.429350 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:17.429386 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:17.430841 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:17.432733 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.432739 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.432752 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.433069 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.433357 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.433360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.433361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.433519 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.433911 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:17.433917 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:17.434230 (+ 313us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.434436 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.434741 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":148,"threads_started":1}
I20260807 18:43:17.436985 12460 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38747
I20260807 18:43:17.437114 12460 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:17.437635 12460 heartbeater.cc:511] Master 127.10.174.254:38747 requested a full tablet report, sending...
I20260807 18:43:17.438704 12099 ts_manager.cc:194] Registered new tserver with Master: b731e844325049fe86065366c4c6da4e (127.10.174.194:36473)
I20260807 18:43:17.439426 12099 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:52725
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:17.447669 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.439830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:39971 (local address 127.10.174.254:38747)
0807 18:43:17.439957 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.439964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.440238 (+ 274us) server_negotiation.cc:407] Connection header received
0807 18:43:17.440368 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.440371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.440416 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.440500 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.441069 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.441658 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.442977 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.443178 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.443255 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.444585 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.444588 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.444589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.444609 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.445984 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.446464 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.446466 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.446467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.446536 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.446839 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.446841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.446842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.447026 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.447101 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.447464 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.447558 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:17.447824 12468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.439733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.10.174.194:39971)
0807 18:43:17.440132 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.440150 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.440272 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.440540 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.440545 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.440795 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:17.440951 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.440958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.441799 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.441805 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.442852 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.442867 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.443313 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.443319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.443454 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.443932 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:17.443951 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:17.444445 (+ 494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:17.446096 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.446100 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.446102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.446368 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.446629 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.446634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.446638 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.446743 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.447125 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:17.447128 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:17.447232 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.447394 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.447549 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":1,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:17.464006 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38747
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:17.576515 12470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:17.576948 12470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:17.577046 12470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:17.583027 12470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:17.583103 12470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:17.583168 12470 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:17.583227 12470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:17.588629 12470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:38747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:17.589751 12470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:17.590754 12470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:17.600152 12476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:17.600155 12475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:17.600149 12478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:17.600455 12470 server_base.cc:1034] running on GCE node
I20260807 18:43:17.600829 12470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:17.601433 12470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:17.602612 12470 hybrid_clock.cc:648] HybridClock initialized: now 1786128197602576 us; error 47 us; skew 500 ppm
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:17.605320 12470 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:17.606127 12470 webserver.cc:460] Webserver started at http://127.10.174.195:39819/ using document root <none> and password file <none>
I20260807 18:43:17.606645 12470 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:17.606704 12470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:17.606952 12470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:17.608947 12470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "6439c72a19bc4ed6aa12d6353cba71f5"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "0dfcc3f4cafe50f35cd883e1f0e75a5c"
server_key_iv: "1b3a09cd6c6fa7db8cdbb478dffb7070"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.609591 12470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "6439c72a19bc4ed6aa12d6353cba71f5"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "0dfcc3f4cafe50f35cd883e1f0e75a5c"
server_key_iv: "1b3a09cd6c6fa7db8cdbb478dffb7070"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.613265 12470 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 18:43:17.615540 12485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:17.616642 12470 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:17.616770 12470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "6439c72a19bc4ed6aa12d6353cba71f5"
format_stamp: "Formatted at 2026-08-07 18:43:17 on dist-test-slave-07c2"
server_key: "0dfcc3f4cafe50f35cd883e1f0e75a5c"
server_key_iv: "1b3a09cd6c6fa7db8cdbb478dffb7070"
server_key_version: "encryptionkey@0"
I20260807 18:43:17.616871 12470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:17.628335 12470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:17.631510 12470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:17.631704 12470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:17.633054 12470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:17.633100 12470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:17.633139 12470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:17.633198 12470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:17.644480 12470 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:45433
I20260807 18:43:17.644848 12603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:45433 every 8 connection(s)
I20260807 18:43:17.645501 12470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:17.647651 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.633942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:54185 (local address 127.10.174.254:38747)
0807 18:43:17.634074 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.634078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.635037 (+ 959us) server_negotiation.cc:407] Connection header received
0807 18:43:17.636077 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.636084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.636153 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.636215 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.638061 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.639002 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.640593 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.640895 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.641021 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.643942 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.643945 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.643947 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.643973 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.645612 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.646239 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.646245 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.646260 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.646359 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.646696 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.646698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.646699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.646878 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.646952 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.647435 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.647535 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:43:17.648394 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.634413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.10.174.195:54185)
0807 18:43:17.634881 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.634921 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.635799 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.636670 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.636676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.637220 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:17.637840 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.637863 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.639136 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.639159 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.640459 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.640470 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.641074 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.641078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.641254 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.641867 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:17.641883 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:17.643762 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:17.645731 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.645736 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.645750 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.646108 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.646458 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.646460 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.646461 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.646591 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.646971 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:17.646976 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:17.647185 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.647384 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.647621 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":140,"threads_started":1}
I20260807 18:43:17.649580 12605 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38747
I20260807 18:43:17.649710 12605 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:17.650238 12605 heartbeater.cc:511] Master 127.10.174.254:38747 requested a full tablet report, sending...
I20260807 18:43:17.650254 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12470
I20260807 18:43:17.650393 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:17.650710 10939 external_mini_cluster.cc:1428] Setting key 27d6e9dee0d47ad976f2a9cbdacd7076
I20260807 18:43:17.651289 12099 ts_manager.cc:194] Registered new tserver with Master: 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433)
I20260807 18:43:17.652055 12099 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:54185
I20260807 18:43:17.652940 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:43:17.660101 12612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.652500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.10.174.195:42827)
0807 18:43:17.652795 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.652811 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.652920 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.653154 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.653157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.653373 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:17.653486 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.653494 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.654531 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.654534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.655089 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.655097 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.655891 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.655898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.656015 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.656548 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:17.656564 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:17.656989 (+ 425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:17.658595 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.658599 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.658603 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.658860 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.659119 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:17.659124 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:17.659127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:17.659242 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:17.659730 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:17.659732 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:17.659803 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.659885 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.659982 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":110,"threads_started":1}
I20260807 18:43:17.660326 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.652537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:42827 (local address 127.10.174.254:38747)
0807 18:43:17.652653 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.652657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.652894 (+ 237us) server_negotiation.cc:407] Connection header received
0807 18:43:17.652999 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.653001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.653043 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.653117 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.653615 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.654386 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.655391 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.655771 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.655884 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.657126 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.657128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.657130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.657151 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.658488 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.658962 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.658965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.658966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.659033 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.659405 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.659410 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.659412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.659626 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.659739 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.659974 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.660105 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 18:43:17 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:17.679752 12150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.672464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54294 (local address 127.10.174.254:38747)
0807 18:43:17.672581 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.672584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.672594 (+ 10us) server_negotiation.cc:407] Connection header received
0807 18:43:17.672623 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.672625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.672656 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.672718 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:17.673354 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.673824 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.674568 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.674768 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.674840 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.677112 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:17.677115 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:17.677117 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:17.677137 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:17.678468 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.678813 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.678815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.678816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.678883 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:17.679101 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:17.679102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:17.679104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:17.679242 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:17.679409 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.679560 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.679643 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:43:17.682369 12098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:17.685483 12098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:17.699388 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.693919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33897 (local address 127.0.0.1:36306)
0807 18:43:17.694693 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.694707 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.694790 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.695154 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.695157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.695174 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:17.695259 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.695265 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.696344 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.696349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.698020 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.698031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.698811 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.698815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.698922 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.698969 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.699073 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.699190 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":154,"spinlock_wait_cycles":5888,"thread_start_us":93,"threads_started":1}
I20260807 18:43:17.699574 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.693391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44974 (local address 127.10.174.194:36473)
0807 18:43:17.694224 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.694238 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.694261 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:43:17.694350 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.694355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.694569 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.695098 (+ 529us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:17.695251 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.696421 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.698147 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.698920 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.699084 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.699231 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.699335 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.699427 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":107,"threads_started":1}
I20260807 18:43:17.699891 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.693983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39770 (local address 127.10.174.195:45433)
0807 18:43:17.695056 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.695069 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.695088 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:43:17.695153 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.695157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.695353 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.695497 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:17.695729 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.696737 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.698020 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.698791 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.699509 (+ 718us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.699632 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.699696 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.699790 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":961,"thread_start_us":97,"threads_started":1}
I20260807 18:43:17.700085 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.694353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36306 (local address 127.10.174.193:33897)
0807 18:43:17.694715 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.694730 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.694754 (+ 24us) server_negotiation.cc:407] Connection header received
0807 18:43:17.694901 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.694905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.695027 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.695178 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:17.695385 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.696229 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.698163 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.698672 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.698841 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.698972 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.699832 (+ 860us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.699909 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":85,"threads_started":1}
I20260807 18:43:17.699550 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.693236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36473 (local address 127.0.0.1:44974)
0807 18:43:17.693587 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.693639 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.694029 (+ 390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.694747 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.694753 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.694788 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:17.694944 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.694951 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.696544 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.696547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.698020 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.698031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.699061 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.699067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.699190 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.699210 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.699303 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.699366 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":142,"spinlock_wait_cycles":5760,"thread_start_us":82,"threads_started":1}
I20260807 18:43:17.699404 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.693825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45433 (local address 127.0.0.1:39770)
0807 18:43:17.694407 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.694419 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.694497 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.695490 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.695493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.695512 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:17.695611 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.695617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.696889 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.696893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.697891 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.697901 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.698937 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.698941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.699059 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.699106 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.699156 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.699226 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":10,"thread_start_us":94,"threads_started":1}
I20260807 18:43:17.702715 12536 tablet_service.cc:1467] Processing CreateTablet for tablet 2199c0d2356c437ebc73ff448775d9a2 (DEFAULT_TABLE table=test-table [id=96748ab9533749c6a148d168fbba4940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:17.702936 12243 tablet_service.cc:1467] Processing CreateTablet for tablet 2199c0d2356c437ebc73ff448775d9a2 (DEFAULT_TABLE table=test-table [id=96748ab9533749c6a148d168fbba4940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:17.702932 12391 tablet_service.cc:1467] Processing CreateTablet for tablet 2199c0d2356c437ebc73ff448775d9a2 (DEFAULT_TABLE table=test-table [id=96748ab9533749c6a148d168fbba4940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:17.703742 12536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2199c0d2356c437ebc73ff448775d9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:17.703890 12243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2199c0d2356c437ebc73ff448775d9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:17.703890 12391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2199c0d2356c437ebc73ff448775d9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:17.710271 12629 tablet_bootstrap.cc:492] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Bootstrap starting.
I20260807 18:43:17.711789 12631 tablet_bootstrap.cc:492] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Bootstrap starting.
I20260807 18:43:17.712615 12629 tablet_bootstrap.cc:654] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:17.713424 12629 log.cc:824] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:17.713662 12631 tablet_bootstrap.cc:654] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:17.714298 12631 log.cc:824] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:17.714929 12630 tablet_bootstrap.cc:492] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Bootstrap starting.
I20260807 18:43:17.715132 12629 tablet_bootstrap.cc:492] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: No bootstrap required, opened a new log
I20260807 18:43:17.715368 12629 ts_tablet_manager.cc:1397] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260807 18:43:17.716478 12631 tablet_bootstrap.cc:492] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: No bootstrap required, opened a new log
I20260807 18:43:17.716650 12631 ts_tablet_manager.cc:1397] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:43:17.716924 12630 tablet_bootstrap.cc:654] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:17.717669 12630 log.cc:824] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:17.718693 12629 raft_consensus.cc:348] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.718914 12629 raft_consensus.cc:374] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:17.718967 12629 raft_consensus.cc:729] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6439c72a19bc4ed6aa12d6353cba71f5, State: Initialized, Role: FOLLOWER
I20260807 18:43:17.719448 12630 tablet_bootstrap.cc:492] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: No bootstrap required, opened a new log
I20260807 18:43:17.719442 12629 consensus_queue.cc:260] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.719621 12630 ts_tablet_manager.cc:1397] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:17.720108 12605 heartbeater.cc:503] Master 127.10.174.254:38747 was elected leader, sending a full tablet report...
I20260807 18:43:17.720476 12629 ts_tablet_manager.cc:1428] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:43:17.720485 12631 raft_consensus.cc:348] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.720726 12631 raft_consensus.cc:374] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:17.720793 12631 raft_consensus.cc:729] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b731e844325049fe86065366c4c6da4e, State: Initialized, Role: FOLLOWER
I20260807 18:43:17.721218 12631 consensus_queue.cc:260] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.722091 12631 ts_tablet_manager.cc:1428] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:43:17.722440 12460 heartbeater.cc:503] Master 127.10.174.254:38747 was elected leader, sending a full tablet report...
I20260807 18:43:17.723246 12630 raft_consensus.cc:348] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.723508 12630 raft_consensus.cc:374] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:17.723573 12630 raft_consensus.cc:729] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd425f2020841159fde44b33128d0a1, State: Initialized, Role: FOLLOWER
I20260807 18:43:17.723908 12630 consensus_queue.cc:260] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.724447 12314 heartbeater.cc:503] Master 127.10.174.254:38747 was elected leader, sending a full tablet report...
I20260807 18:43:17.725566 12630 ts_tablet_manager.cc:1428] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 18:43:17.896576 12606 tablet.cc:2369] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:43:17.935128 12461 tablet.cc:2369] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:17.957885 12638 raft_consensus.cc:482] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:17.958117 12638 raft_consensus.cc:504] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
W20260807 18:43:17.958212 12315 tablet.cc:2369] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:17.959604 12638 leader_election.cc:288] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b731e844325049fe86065366c4c6da4e (127.10.174.194:36473), 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433)
I20260807 18:43:17.964871 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.960016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:53911 (local address 127.10.174.195:45433)
0807 18:43:17.960146 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.960153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.960308 (+ 155us) server_negotiation.cc:407] Connection header received
0807 18:43:17.960407 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.960410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.960463 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.960550 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:17.961002 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.961787 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.963528 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.964119 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.964260 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.964300 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.964672 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.964741 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 18:43:17.964871 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.959935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:37197 (local address 127.10.174.194:36473)
0807 18:43:17.960078 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.960083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.960295 (+ 212us) server_negotiation.cc:407] Connection header received
0807 18:43:17.960408 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.960411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.960463 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.960550 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:17.961002 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.961793 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.963528 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.964119 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.964246 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.964298 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.964672 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.964741 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:43:17.964943 12640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.959902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45433 (local address 127.10.174.193:53911)
0807 18:43:17.960215 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.960229 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.960316 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.960596 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.960598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.960612 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:17.960878 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.960886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.961908 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.961912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.963397 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.963407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.964270 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.964274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.964476 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.964559 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.964644 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.964756 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":297,"spinlock_wait_cycles":384,"thread_start_us":122,"threads_started":1}
I20260807 18:43:17.964946 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.959823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36473 (local address 127.10.174.193:37197)
0807 18:43:17.960167 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:17.960182 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:17.960308 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:17.960583 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:17.960586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:17.960606 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:17.960880 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.960886 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.961908 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.961912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.963395 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:17.963407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.964270 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.964274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:17.964478 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.964558 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 18:43:17.964644 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 18:43:17.964756 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":251,"thread_start_us":90,"threads_started":1}
I20260807 18:43:17.965586 12413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2199c0d2356c437ebc73ff448775d9a2" candidate_uuid: "fdd425f2020841159fde44b33128d0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b731e844325049fe86065366c4c6da4e" is_pre_election: true
I20260807 18:43:17.965598 12548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2199c0d2356c437ebc73ff448775d9a2" candidate_uuid: "fdd425f2020841159fde44b33128d0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" is_pre_election: true
I20260807 18:43:17.965873 12548 raft_consensus.cc:2454] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdd425f2020841159fde44b33128d0a1 in term 0.
I20260807 18:43:17.965883 12413 raft_consensus.cc:2454] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdd425f2020841159fde44b33128d0a1 in term 0.
I20260807 18:43:17.966389 12195 leader_election.cc:302] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6439c72a19bc4ed6aa12d6353cba71f5, b731e844325049fe86065366c4c6da4e, fdd425f2020841159fde44b33128d0a1; no voters:
I20260807 18:43:17.966686 12638 raft_consensus.cc:2781] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:17.966763 12638 raft_consensus.cc:482] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:17.966807 12638 raft_consensus.cc:3037] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:17.967998 12638 raft_consensus.cc:504] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.968364 12638 leader_election.cc:288] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [CANDIDATE]: Term 1 election: Requested vote from peers b731e844325049fe86065366c4c6da4e (127.10.174.194:36473), 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433)
I20260807 18:43:17.968670 12413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2199c0d2356c437ebc73ff448775d9a2" candidate_uuid: "fdd425f2020841159fde44b33128d0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b731e844325049fe86065366c4c6da4e"
I20260807 18:43:17.968786 12413 raft_consensus.cc:3037] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:17.968806 12548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2199c0d2356c437ebc73ff448775d9a2" candidate_uuid: "fdd425f2020841159fde44b33128d0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6439c72a19bc4ed6aa12d6353cba71f5"
I20260807 18:43:17.968947 12548 raft_consensus.cc:3037] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:17.969779 12413 raft_consensus.cc:2454] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdd425f2020841159fde44b33128d0a1 in term 1.
I20260807 18:43:17.970187 12194 leader_election.cc:302] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b731e844325049fe86065366c4c6da4e, fdd425f2020841159fde44b33128d0a1; no voters:
I20260807 18:43:17.970438 12638 raft_consensus.cc:2781] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:17.970695 12638 raft_consensus.cc:686] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 1 LEADER]: Becoming Leader. State: Replica: fdd425f2020841159fde44b33128d0a1, State: Running, Role: LEADER
I20260807 18:43:17.970920 12548 raft_consensus.cc:2454] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdd425f2020841159fde44b33128d0a1 in term 1.
I20260807 18:43:17.971037 12638 consensus_queue.cc:237] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:17.974150 12099 catalog_manager.cc:5495] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdd425f2020841159fde44b33128d0a1 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "fdd425f2020841159fde44b33128d0a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:17.997871 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:17.993976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36316 (local address 127.10.174.193:33897)
0807 18:43:17.994125 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:17.994130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:17.994145 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:43:17.994362 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:17.994365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:17.994421 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:17.994527 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:17.994808 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.995382 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.996272 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:17.996484 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:17.996593 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:17.996973 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:17.997410 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:17.997506 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:17.997608 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 18:43:17.997692 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:43:18.003953 12413 raft_consensus.cc:1261] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Refusing update from remote peer fdd425f2020841159fde44b33128d0a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:18.004725 12638 consensus_queue.cc:1035] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:18.005064 12548 raft_consensus.cc:1261] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Refusing update from remote peer fdd425f2020841159fde44b33128d0a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:18.005661 12638 consensus_queue.cc:1035] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:18.013502 12645 mvcc.cc:205] Tried to move back new op lower bound from 7315981099016044544 to 7315981098892374016. Current Snapshot: MvccSnapshot[applied={T|T < 7315981099016044544}]
I20260807 18:43:18.014650 12646 mvcc.cc:205] Tried to move back new op lower bound from 7315981099016044544 to 7315981098892374016. Current Snapshot: MvccSnapshot[applied={T|T < 7315981099016044544}]
I20260807 18:43:18.025781 12098 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:18.026074 12098 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:18.029105 12098 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: Sending DeleteTablet for 3 replicas of tablet 2199c0d2356c437ebc73ff448775d9a2
I20260807 18:43:18.030012 12536 tablet_service.cc:1514] Processing DeleteTablet for tablet 2199c0d2356c437ebc73ff448775d9a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:18 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:39770
I20260807 18:43:18.030279 12391 tablet_service.cc:1514] Processing DeleteTablet for tablet 2199c0d2356c437ebc73ff448775d9a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:18 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:44974
I20260807 18:43:18.030668 12243 tablet_service.cc:1514] Processing DeleteTablet for tablet 2199c0d2356c437ebc73ff448775d9a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:18 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:36306
I20260807 18:43:18.030902 12098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:43:18.031136 12657 tablet_replica.cc:330] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: stopping tablet replica
W20260807 18:43:18.031332 12098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:18.031498 12657 raft_consensus.cc:2229] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:18.031715 12654 tablet_replica.cc:330] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: stopping tablet replica
I20260807 18:43:18.031855 12655 tablet_replica.cc:330] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: stopping tablet replica
I20260807 18:43:18.031966 12657 raft_consensus.cc:2258] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:18.032333 12654 raft_consensus.cc:2229] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:18.033005 12655 raft_consensus.cc:2229] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:18.033372 12655 raft_consensus.cc:2258] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:18.033521 12657 ts_tablet_manager.cc:1905] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:18.033800 12654 raft_consensus.cc:2258] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:18.036474 12536 tablet_service.cc:1467] Processing CreateTablet for tablet 66240d32adc84127a6bbd90c2a524e64 (DEFAULT_TABLE table=test-table [id=881ae8af0bd84cc6bd712951e47ca771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:18.036794 12536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66240d32adc84127a6bbd90c2a524e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:18.037014 12655 ts_tablet_manager.cc:1905] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:18.036989 12657 ts_tablet_manager.cc:1918] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:18.037128 12657 log.cc:1196] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/2199c0d2356c437ebc73ff448775d9a2
I20260807 18:43:18.037240 12654 ts_tablet_manager.cc:1905] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:18.037459 12657 ts_tablet_manager.cc:1939] T 2199c0d2356c437ebc73ff448775d9a2 P fdd425f2020841159fde44b33128d0a1: Deleting consensus metadata
I20260807 18:43:18.039274 12629 tablet_bootstrap.cc:492] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Bootstrap starting.
I20260807 18:43:18.039909 12084 catalog_manager.cc:4841] TS fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897): tablet 2199c0d2356c437ebc73ff448775d9a2 (table test-table [id=96748ab9533749c6a148d168fbba4940]) successfully deleted
I20260807 18:43:18.040397 12654 ts_tablet_manager.cc:1918] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:18.040426 12243 tablet_service.cc:1467] Processing CreateTablet for tablet 66240d32adc84127a6bbd90c2a524e64 (DEFAULT_TABLE table=test-table [id=881ae8af0bd84cc6bd712951e47ca771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:18.040617 12654 log.cc:1196] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/2199c0d2356c437ebc73ff448775d9a2
I20260807 18:43:18.040699 12243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66240d32adc84127a6bbd90c2a524e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:18.040643 12629 tablet_bootstrap.cc:654] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:18.041129 12654 ts_tablet_manager.cc:1939] T 2199c0d2356c437ebc73ff448775d9a2 P 6439c72a19bc4ed6aa12d6353cba71f5: Deleting consensus metadata
I20260807 18:43:18.042968 12630 tablet_bootstrap.cc:492] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Bootstrap starting.
I20260807 18:43:18.042975 12629 tablet_bootstrap.cc:492] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: No bootstrap required, opened a new log
I20260807 18:43:18.043058 12629 ts_tablet_manager.cc:1397] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 18:43:18.043589 12629 raft_consensus.cc:348] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.043722 12629 raft_consensus.cc:374] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:18.043761 12629 raft_consensus.cc:729] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6439c72a19bc4ed6aa12d6353cba71f5, State: Initialized, Role: FOLLOWER
I20260807 18:43:18.043888 12629 consensus_queue.cc:260] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.044047 12630 tablet_bootstrap.cc:654] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:18.044153 12629 ts_tablet_manager.cc:1428] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:18.044813 12655 ts_tablet_manager.cc:1918] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:18.044979 12655 log.cc:1196] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/2199c0d2356c437ebc73ff448775d9a2
I20260807 18:43:18.045297 12630 tablet_bootstrap.cc:492] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: No bootstrap required, opened a new log
I20260807 18:43:18.045385 12630 ts_tablet_manager.cc:1397] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:18.045332 12085 catalog_manager.cc:4841] TS 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433): tablet 2199c0d2356c437ebc73ff448775d9a2 (table test-table [id=96748ab9533749c6a148d168fbba4940]) successfully deleted
I20260807 18:43:18.045499 12655 ts_tablet_manager.cc:1939] T 2199c0d2356c437ebc73ff448775d9a2 P b731e844325049fe86065366c4c6da4e: Deleting consensus metadata
I20260807 18:43:18.045831 12630 raft_consensus.cc:348] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.045945 12630 raft_consensus.cc:374] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:18.045982 12630 raft_consensus.cc:729] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd425f2020841159fde44b33128d0a1, State: Initialized, Role: FOLLOWER
I20260807 18:43:18.046103 12630 consensus_queue.cc:260] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.046340 12630 ts_tablet_manager.cc:1428] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:18.046366 12391 tablet_service.cc:1467] Processing CreateTablet for tablet 66240d32adc84127a6bbd90c2a524e64 (DEFAULT_TABLE table=test-table [id=881ae8af0bd84cc6bd712951e47ca771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:18.046631 12391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66240d32adc84127a6bbd90c2a524e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:18.047363 12084 catalog_manager.cc:4841] TS b731e844325049fe86065366c4c6da4e (127.10.174.194:36473): tablet 2199c0d2356c437ebc73ff448775d9a2 (table test-table [id=96748ab9533749c6a148d168fbba4940]) successfully deleted
I20260807 18:43:18.049226 12631 tablet_bootstrap.cc:492] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Bootstrap starting.
I20260807 18:43:18.050443 12631 tablet_bootstrap.cc:654] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:18.052098 12631 tablet_bootstrap.cc:492] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: No bootstrap required, opened a new log
I20260807 18:43:18.052212 12631 ts_tablet_manager.cc:1397] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 18:43:18.052603 12631 raft_consensus.cc:348] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.052728 12631 raft_consensus.cc:374] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:18.052793 12631 raft_consensus.cc:729] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b731e844325049fe86065366c4c6da4e, State: Initialized, Role: FOLLOWER
I20260807 18:43:18.052960 12631 consensus_queue.cc:260] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.053258 12631 ts_tablet_manager.cc:1428] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:18.204911 12636 raft_consensus.cc:482] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:18.205076 12636 raft_consensus.cc:504] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.206182 12636 leader_election.cc:288] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897), b731e844325049fe86065366c4c6da4e (127.10.174.194:36473)
I20260807 18:43:18.211208 12661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.206395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33897 (local address 127.10.174.195:44527)
0807 18:43:18.206735 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.206753 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.206932 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.207334 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.207338 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.207355 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:18.207476 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.207482 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.208553 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.208556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.209845 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.209850 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.210698 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.210702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.210815 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.210841 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.210948 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.211037 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":49,"thread_start_us":126,"threads_started":1}
I20260807 18:43:18.211230 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.206498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:44527 (local address 127.10.174.193:33897)
0807 18:43:18.206691 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.206696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.206841 (+ 145us) server_negotiation.cc:407] Connection header received
0807 18:43:18.207057 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.207071 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.207120 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.207169 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:18.207604 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.208442 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.210006 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.210579 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.210708 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.210760 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.210997 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.211092 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 18:43:18.211324 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.206975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:49353 (local address 127.10.174.194:36473)
0807 18:43:18.207183 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.207190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.207208 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:43:18.207415 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.207419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.207470 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.207556 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:18.207830 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.208325 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.209972 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.210708 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.210828 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.210877 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.211091 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.211171 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 18:43:18.211679 12662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.206880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36473 (local address 127.10.174.195:49353)
0807 18:43:18.207131 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.207144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.207264 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.207572 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.207575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.207600 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:18.207714 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.207719 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.208436 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.208443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.209838 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.209850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.210844 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.210847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.210950 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.210970 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.211507 (+ 537us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.211583 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":37,"thread_start_us":67,"threads_started":1}
I20260807 18:43:18.212116 12263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66240d32adc84127a6bbd90c2a524e64" candidate_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdd425f2020841159fde44b33128d0a1" is_pre_election: true
I20260807 18:43:18.212339 12263 raft_consensus.cc:2454] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6439c72a19bc4ed6aa12d6353cba71f5 in term 0.
I20260807 18:43:18.212633 12413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66240d32adc84127a6bbd90c2a524e64" candidate_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b731e844325049fe86065366c4c6da4e" is_pre_election: true
I20260807 18:43:18.212785 12413 raft_consensus.cc:2454] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6439c72a19bc4ed6aa12d6353cba71f5 in term 0.
I20260807 18:43:18.212771 12488 leader_election.cc:302] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6439c72a19bc4ed6aa12d6353cba71f5, fdd425f2020841159fde44b33128d0a1; no voters:
I20260807 18:43:18.213043 12636 raft_consensus.cc:2781] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:18.213114 12636 raft_consensus.cc:482] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:18.213151 12636 raft_consensus.cc:3037] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:18.214262 12636 raft_consensus.cc:504] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.214634 12636 leader_election.cc:288] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [CANDIDATE]: Term 1 election: Requested vote from peers fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897), b731e844325049fe86065366c4c6da4e (127.10.174.194:36473)
I20260807 18:43:18.214926 12263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66240d32adc84127a6bbd90c2a524e64" candidate_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdd425f2020841159fde44b33128d0a1"
I20260807 18:43:18.215054 12263 raft_consensus.cc:3037] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:18.215415 12413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66240d32adc84127a6bbd90c2a524e64" candidate_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b731e844325049fe86065366c4c6da4e"
I20260807 18:43:18.215560 12413 raft_consensus.cc:3037] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:18.216306 12263 raft_consensus.cc:2454] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6439c72a19bc4ed6aa12d6353cba71f5 in term 1.
I20260807 18:43:18.216506 12413 raft_consensus.cc:2454] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6439c72a19bc4ed6aa12d6353cba71f5 in term 1.
I20260807 18:43:18.216591 12488 leader_election.cc:302] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6439c72a19bc4ed6aa12d6353cba71f5, fdd425f2020841159fde44b33128d0a1; no voters:
I20260807 18:43:18.216760 12636 raft_consensus.cc:2781] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:18.216939 12636 raft_consensus.cc:686] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 LEADER]: Becoming Leader. State: Replica: 6439c72a19bc4ed6aa12d6353cba71f5, State: Running, Role: LEADER
I20260807 18:43:18.217192 12636 consensus_queue.cc:237] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.219496 12098 catalog_manager.cc:5495] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } health_report { overall_health: HEALTHY } } }
Aug 07 18:43:18 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128196, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:18.269667 12671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.261073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.10.174.254:38747)
0807 18:43:18.261411 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.261420 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.261495 (+ 75us) server_negotiation.cc:407] Connection header received
0807 18:43:18.261664 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.261667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.261711 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.261808 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:18.262465 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.263010 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.263856 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.264080 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.264204 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.266463 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:18.266466 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:18.266468 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:18.266488 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:18.267850 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:18.268324 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:18.268328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:18.268331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:18.268436 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:18.268736 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:18.268741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:18.268743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:18.268920 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:18.269027 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.269367 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.269523 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":285,"thread_start_us":116,"threads_started":1}
I20260807 18:43:18.269670 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.261036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38747 (local address 127.0.0.1:54304)
0807 18:43:18.261415 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.261431 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.261553 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.261826 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.261829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.262248 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:18.262337 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.262344 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.263117 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.263123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.263725 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.263734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.264203 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.264207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.264297 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.264877 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:18.264888 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:18.266322 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:18.267961 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:18.267972 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:18.267979 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:18.268207 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:18.268553 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:18.268556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:18.268558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:18.268639 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:18.269025 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:18.269032 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:18.269180 (+ 148us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.269307 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.269466 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":119,"threads_started":1}
I20260807 18:43:18.273614 12098 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:54304:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 18:43:18.274394 12098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:18.279175 12243 tablet_service.cc:1467] Processing CreateTablet for tablet 0f87d205e861421fadc9f5de75119f8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f53ca349ea844f1ba98b4cd9838a831b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:18.279172 12391 tablet_service.cc:1467] Processing CreateTablet for tablet 0f87d205e861421fadc9f5de75119f8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f53ca349ea844f1ba98b4cd9838a831b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:18.279331 12536 tablet_service.cc:1467] Processing CreateTablet for tablet 0f87d205e861421fadc9f5de75119f8f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f53ca349ea844f1ba98b4cd9838a831b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:18.279654 12243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f87d205e861421fadc9f5de75119f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:18.279666 12391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f87d205e861421fadc9f5de75119f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:18.279685 12536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f87d205e861421fadc9f5de75119f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:18.282011 12630 tablet_bootstrap.cc:492] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: Bootstrap starting.
I20260807 18:43:18.282582 12629 tablet_bootstrap.cc:492] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: Bootstrap starting.
I20260807 18:43:18.282582 12631 tablet_bootstrap.cc:492] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: Bootstrap starting.
I20260807 18:43:18.282955 12630 tablet_bootstrap.cc:654] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:18.283731 12631 tablet_bootstrap.cc:654] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:18.283731 12629 tablet_bootstrap.cc:654] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:18.285014 12631 tablet_bootstrap.cc:492] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: No bootstrap required, opened a new log
I20260807 18:43:18.285104 12631 ts_tablet_manager.cc:1397] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 18:43:18.285209 12630 tablet_bootstrap.cc:492] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: No bootstrap required, opened a new log
I20260807 18:43:18.285290 12630 ts_tablet_manager.cc:1397] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 18:43:18.285367 12629 tablet_bootstrap.cc:492] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: No bootstrap required, opened a new log
I20260807 18:43:18.285434 12629 ts_tablet_manager.cc:1397] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 18:43:18.285549 12631 raft_consensus.cc:348] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.285631 12631 raft_consensus.cc:374] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:18.285651 12631 raft_consensus.cc:729] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b731e844325049fe86065366c4c6da4e, State: Initialized, Role: FOLLOWER
I20260807 18:43:18.285703 12630 raft_consensus.cc:348] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.285815 12630 raft_consensus.cc:374] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:18.285777 12631 consensus_queue.cc:260] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.285851 12630 raft_consensus.cc:729] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd425f2020841159fde44b33128d0a1, State: Initialized, Role: FOLLOWER
I20260807 18:43:18.285902 12629 raft_consensus.cc:348] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.286003 12629 raft_consensus.cc:374] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:18.285972 12630 consensus_queue.cc:260] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.286034 12629 raft_consensus.cc:729] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6439c72a19bc4ed6aa12d6353cba71f5, State: Initialized, Role: FOLLOWER
I20260807 18:43:18.286063 12637 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.286141 12629 consensus_queue.cc:260] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.286213 12637 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.286244 12630 ts_tablet_manager.cc:1428] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:18.286404 12629 ts_tablet_manager.cc:1428] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:18.286377 12636 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.286499 12636 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.286448 12649 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.286579 12649 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.286065 12631 ts_tablet_manager.cc:1428] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:18.293455 12637 raft_consensus.cc:482] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:18.293550 12637 raft_consensus.cc:504] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.294464 12637 leader_election.cc:288] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897), 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433)
I20260807 18:43:18.298468 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.294840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:39095 (local address 127.10.174.193:33897)
0807 18:43:18.294950 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.294955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.295278 (+ 323us) server_negotiation.cc:407] Connection header received
0807 18:43:18.295431 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.295437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.295506 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.295584 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:18.295891 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.296386 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.297520 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.297908 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.298030 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.298084 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.298272 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.298346 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 18:43:18.298496 12675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.294729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33897 (local address 127.10.174.194:39095)
0807 18:43:18.295159 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.295172 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.295335 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.295588 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.295591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.295611 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:18.295742 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.295748 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.296499 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.296504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.297391 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.297400 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.298024 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.298028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.298137 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.298164 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.298250 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.298318 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":24,"thread_start_us":160,"threads_started":1}
I20260807 18:43:18.298487 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.294771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:35623 (local address 127.10.174.195:45433)
0807 18:43:18.294943 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.294948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.295355 (+ 407us) server_negotiation.cc:407] Connection header received
0807 18:43:18.295530 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.295533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.295579 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.295645 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:18.295958 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.296438 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.297548 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.297943 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.298071 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.298116 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.298303 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.298371 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 18:43:18.298511 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.294703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45433 (local address 127.10.174.194:35623)
0807 18:43:18.295116 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.295128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.295430 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.295737 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.295740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.295754 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:18.295867 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.295875 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.296554 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.296558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.297421 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.297430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.298072 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.298075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.298182 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.298199 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.298285 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.298353 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":17,"thread_start_us":139,"threads_started":1}
I20260807 18:43:18.298903 12263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f87d205e861421fadc9f5de75119f8f" candidate_uuid: "b731e844325049fe86065366c4c6da4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdd425f2020841159fde44b33128d0a1" is_pre_election: true
I20260807 18:43:18.299045 12263 raft_consensus.cc:2454] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b731e844325049fe86065366c4c6da4e in term 0.
I20260807 18:43:18.299124 12548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f87d205e861421fadc9f5de75119f8f" candidate_uuid: "b731e844325049fe86065366c4c6da4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" is_pre_election: true
I20260807 18:43:18.299304 12548 raft_consensus.cc:2454] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b731e844325049fe86065366c4c6da4e in term 0.
I20260807 18:43:18.299422 12341 leader_election.cc:302] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b731e844325049fe86065366c4c6da4e, fdd425f2020841159fde44b33128d0a1; no voters:
I20260807 18:43:18.299717 12637 raft_consensus.cc:2781] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:18.299790 12637 raft_consensus.cc:482] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:18.299839 12637 raft_consensus.cc:3037] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:18.300876 12637 raft_consensus.cc:504] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.301155 12637 leader_election.cc:288] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [CANDIDATE]: Term 1 election: Requested vote from peers fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897), 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433)
I20260807 18:43:18.301441 12263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f87d205e861421fadc9f5de75119f8f" candidate_uuid: "b731e844325049fe86065366c4c6da4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdd425f2020841159fde44b33128d0a1"
I20260807 18:43:18.301491 12548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f87d205e861421fadc9f5de75119f8f" candidate_uuid: "b731e844325049fe86065366c4c6da4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6439c72a19bc4ed6aa12d6353cba71f5"
I20260807 18:43:18.301565 12263 raft_consensus.cc:3037] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:18.301581 12548 raft_consensus.cc:3037] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:18.302644 12263 raft_consensus.cc:2454] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b731e844325049fe86065366c4c6da4e in term 1.
I20260807 18:43:18.302644 12548 raft_consensus.cc:2454] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b731e844325049fe86065366c4c6da4e in term 1.
I20260807 18:43:18.302944 12342 leader_election.cc:302] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6439c72a19bc4ed6aa12d6353cba71f5, b731e844325049fe86065366c4c6da4e; no voters:
I20260807 18:43:18.303126 12637 raft_consensus.cc:2781] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:18.303364 12637 raft_consensus.cc:686] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [term 1 LEADER]: Becoming Leader. State: Replica: b731e844325049fe86065366c4c6da4e, State: Running, Role: LEADER
I20260807 18:43:18.303617 12637 consensus_queue.cc:237] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } }
I20260807 18:43:18.304817 12677 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: TxnStatusTablet state changed. Reason: New leader b731e844325049fe86065366c4c6da4e. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.304930 12677 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:18.305240 12679 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 18:43:18.305460 12679 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 18:43:18.305995 12099 catalog_manager.cc:5495] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e reported cstate change: term changed from 0 to 1, leader changed from <none> to b731e844325049fe86065366c4c6da4e (127.10.174.194). New cstate: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:18.330154 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.319498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36473 (local address 127.0.0.1:44982)
0807 18:43:18.323896 (+ 4398us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.323918 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.324057 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.325857 (+ 1800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.325860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.325868 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:18.325975 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.325981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.327003 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.327006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.327999 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.328010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.328782 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.328786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.328881 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.328936 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.329824 (+ 888us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.329841 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.329909 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.330004 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4233}
I20260807 18:43:18.330212 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.325316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.10.174.194:36473)
0807 18:43:18.325460 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.325465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.325481 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:18.325553 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.325556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.325616 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.325719 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:18.326094 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.326873 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.328137 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.328633 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.328780 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.329107 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.329712 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.329852 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.329937 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.330012 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 18:43:18.333838 12548 raft_consensus.cc:1261] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Refusing update from remote peer b731e844325049fe86065366c4c6da4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:18.334203 12263 raft_consensus.cc:1261] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Refusing update from remote peer b731e844325049fe86065366c4c6da4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:18.334513 12637 consensus_queue.cc:1035] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:18.334779 12677 consensus_queue.cc:1035] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:18.336088 12636 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: TxnStatusTablet state changed. Reason: New leader b731e844325049fe86065366c4c6da4e. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.336196 12636 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.336869 12649 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: TxnStatusTablet state changed. Reason: New leader b731e844325049fe86065366c4c6da4e. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.337002 12649 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.341662 12637 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.341804 12637 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:18.342633 12636 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.342736 12636 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P 6439c72a19bc4ed6aa12d6353cba71f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.345324 12637 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.345456 12637 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P b731e844325049fe86065366c4c6da4e: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:18.347667 12644 mvcc.cc:205] Tried to move back new op lower bound from 7315981100369948672 to 7315981100253724672. Current Snapshot: MvccSnapshot[applied={T|T < 7315981100369948672}]
I20260807 18:43:18.347857 12649 tablet_replica.cc:439] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b731e844325049fe86065366c4c6da4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 } } peers { permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 } } peers { permanent_uuid: "6439c72a19bc4ed6aa12d6353cba71f5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45433 } } }
I20260807 18:43:18.347965 12649 tablet_replica.cc:442] T 0f87d205e861421fadc9f5de75119f8f P fdd425f2020841159fde44b33128d0a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:18.354403 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.349510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39784 (local address 127.10.174.195:45433)
0807 18:43:18.349626 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.349631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.349647 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:18.349718 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.349721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.349793 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.349906 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:18.350250 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.351027 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.352475 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.352878 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.352983 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.353322 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.353877 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.353984 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.354165 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.354236 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 18:43:18.368942 12688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.363989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36473 (local address 127.10.174.195:36275)
0807 18:43:18.364334 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.364348 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.364449 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.364736 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.364739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.364754 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:18.364867 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.364873 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.366030 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.366034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.367116 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.367130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.367958 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.367963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.368077 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.368128 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.368502 (+ 374us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.368567 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.368696 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.368784 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":127,"threads_started":1}
I20260807 18:43:18.368984 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.364050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:36275 (local address 127.10.174.194:36473)
0807 18:43:18.364158 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.364162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.364437 (+ 275us) server_negotiation.cc:407] Connection header received
0807 18:43:18.364538 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.364543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.364623 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.364716 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:18.364980 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.365895 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.367251 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.367744 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.367868 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.368312 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.368405 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.368486 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.368688 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.368759 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 18:43:18.379204 12413 raft_consensus.cc:1261] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Refusing update from remote peer 6439c72a19bc4ed6aa12d6353cba71f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:18.379225 12263 raft_consensus.cc:1261] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Refusing update from remote peer 6439c72a19bc4ed6aa12d6353cba71f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:18.379904 12663 consensus_queue.cc:1035] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b731e844325049fe86065366c4c6da4e" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:18.380155 12636 consensus_queue.cc:1035] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdd425f2020841159fde44b33128d0a1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:18.413196 12694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.408200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45433 (local address 127.10.174.194:50053)
0807 18:43:18.408527 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:18.408557 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:18.408660 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:18.408939 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:18.408943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:18.408953 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:18.409056 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.409062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.410516 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.410519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.411694 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:18.411705 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.412418 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.412422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:18.412512 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.412562 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.412892 (+ 330us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.412898 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:43:18.412962 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 18:43:18.413041 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":134,"threads_started":1}
I20260807 18:43:18.413241 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.408289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:50053 (local address 127.10.174.195:45433)
0807 18:43:18.408420 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.408428 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.408639 (+ 211us) server_negotiation.cc:407] Connection header received
0807 18:43:18.408749 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.408754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.408818 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.408905 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:18.409168 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.410171 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.411825 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.412287 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.412417 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.412702 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:18.412799 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:18.412879 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.412974 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.413043 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 18:43:18.450762 12098 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:18.450918 12098 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:18.452981 12098 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d734ea47f874a63acd07a54d364b591: Sending DeleteTablet for 3 replicas of tablet 66240d32adc84127a6bbd90c2a524e64
I20260807 18:43:18.454056 12536 tablet_service.cc:1514] Processing DeleteTablet for tablet 66240d32adc84127a6bbd90c2a524e64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:18 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:39770
I20260807 18:43:18.454178 12243 tablet_service.cc:1514] Processing DeleteTablet for tablet 66240d32adc84127a6bbd90c2a524e64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:18 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:36306
I20260807 18:43:18.454346 12391 tablet_service.cc:1514] Processing DeleteTablet for tablet 66240d32adc84127a6bbd90c2a524e64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:18 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:44974
I20260807 18:43:18.454493 12655 tablet_replica.cc:330] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: stopping tablet replica
I20260807 18:43:18.454501 12657 tablet_replica.cc:330] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: stopping tablet replica
I20260807 18:43:18.454599 12655 raft_consensus.cc:2229] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:18.454604 12657 raft_consensus.cc:2229] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:18.454703 12655 raft_consensus.cc:2258] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:18.454715 12657 raft_consensus.cc:2258] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:18.455361 12654 tablet_replica.cc:330] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: stopping tablet replica
I20260807 18:43:18.455487 12654 raft_consensus.cc:2229] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:18.455642 12655 ts_tablet_manager.cc:1905] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:18.455808 12654 raft_consensus.cc:2258] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:18.456995 12654 ts_tablet_manager.cc:1905] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:18.459826 12654 ts_tablet_manager.cc:1918] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:18.459899 12654 log.cc:1196] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/66240d32adc84127a6bbd90c2a524e64
I20260807 18:43:18.460180 12654 ts_tablet_manager.cc:1939] T 66240d32adc84127a6bbd90c2a524e64 P 6439c72a19bc4ed6aa12d6353cba71f5: Deleting consensus metadata
I20260807 18:43:18.460431 12657 ts_tablet_manager.cc:1905] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:18.460865 12085 catalog_manager.cc:4841] TS 6439c72a19bc4ed6aa12d6353cba71f5 (127.10.174.195:45433): tablet 66240d32adc84127a6bbd90c2a524e64 (table test-table [id=881ae8af0bd84cc6bd712951e47ca771]) successfully deleted
I20260807 18:43:18.464160 12657 ts_tablet_manager.cc:1918] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:18.464265 12657 log.cc:1196] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/66240d32adc84127a6bbd90c2a524e64
I20260807 18:43:18.464563 12657 ts_tablet_manager.cc:1939] T 66240d32adc84127a6bbd90c2a524e64 P fdd425f2020841159fde44b33128d0a1: Deleting consensus metadata
I20260807 18:43:18.465329 12084 catalog_manager.cc:4841] TS fdd425f2020841159fde44b33128d0a1 (127.10.174.193:33897): tablet 66240d32adc84127a6bbd90c2a524e64 (table test-table [id=881ae8af0bd84cc6bd712951e47ca771]) successfully deleted
I20260807 18:43:18.465770 12655 ts_tablet_manager.cc:1918] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:18.465862 12655 log.cc:1196] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/66240d32adc84127a6bbd90c2a524e64
I20260807 18:43:18.466140 12655 ts_tablet_manager.cc:1939] T 66240d32adc84127a6bbd90c2a524e64 P b731e844325049fe86065366c4c6da4e: Deleting consensus metadata
I20260807 18:43:18.467165 12084 catalog_manager.cc:4841] TS b731e844325049fe86065366c4c6da4e (127.10.174.194:36473): tablet 66240d32adc84127a6bbd90c2a524e64 (table test-table [id=881ae8af0bd84cc6bd712951e47ca771]) successfully deleted
Aug 07 18:43:18 dist-test-slave-07c2 krb5kdc[12052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128197, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:18.498039 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.464708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45052 (local address 127.10.174.193:33897)
0807 18:43:18.464839 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.464844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.475631 (+ 10787us) server_negotiation.cc:407] Connection header received
0807 18:43:18.475835 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.475841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.475890 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.475942 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:18.477000 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.477825 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.479172 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.479530 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.479617 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.488885 (+ 9268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:18.488899 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:18.488918 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:18.488950 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:18.491250 (+ 2300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:18.493517 (+ 2267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:18.493527 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:18.493559 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:18.493695 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:18.495610 (+ 1915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:18.495615 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:18.495619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:18.496937 (+ 1318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:18.497164 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.497631 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.497792 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 18:43:18.499164 12308 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45052
I20260807 18:43:18.513073 12671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:18.501955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.10.174.254:38747)
0807 18:43:18.502119 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:18.502125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:18.502672 (+ 547us) server_negotiation.cc:407] Connection header received
0807 18:43:18.502876 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:18.502880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:18.502942 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:18.503002 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:18.504079 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.505031 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.506418 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:18.506862 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:18.506968 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:18.508960 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:18.508966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:18.508973 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:18.509005 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:18.510797 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:18.511427 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:18.511433 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:18.511436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:18.511534 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:18.511876 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:18.511881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:18.511884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:18.512138 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:18.512269 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:18.512654 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 18:43:18.512806 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 18:43:18.514205 12098 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34716
I20260807 18:43:18.516533 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12173
I20260807 18:43:18.529239 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12323
I20260807 18:43:18.539465 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12470
I20260807 18:43:18.547412 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12066
2026-08-07T18:43:18Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2988 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:18 dist-test-slave-07c2 krb5kdc[12703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:18 dist-test-slave-07c2 krb5kdc[12703](info): set up 2 sockets
Aug 07 18:43:18 dist-test-slave-07c2 krb5kdc[12703](info): commencing operation
krb5kdc: starting...
W20260807 18:43:19.598618 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:19 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:19.715883 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36365
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:36365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:19.822690 12717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:19.823017 12717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:19.823125 12717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:19.827026 12717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:19.827109 12717 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 18:43:19.827140 12717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:19.827183 12717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:19.827216 12717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:19.827253 12717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:19.832423 12717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:36365
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:19.833441 12717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:19.834446 12717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:43:19.842896 12717 server_base.cc:1034] running on GCE node
W20260807 18:43:19.842846 12723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:19.842847 12724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:19.843088 12726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:19.843632 12717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:19.844666 12717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:19.845850 12717 hybrid_clock.cc:648] HybridClock initialized: now 1786128199845831 us; error 44 us; skew 500 ppm
Aug 07 18:43:19 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128199, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:19.848654 12717 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:19.849551 12717 webserver.cc:460] Webserver started at http://127.10.174.254:39039/ using document root <none> and password file <none>
I20260807 18:43:19.850097 12717 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:19.850188 12717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:19.850430 12717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:19.852479 12717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "411446fa6d454013b6e04bd386117eec"
format_stamp: "Formatted at 2026-08-07 18:43:19 on dist-test-slave-07c2"
server_key: "8b4740b25704e6fbaa6da4347d273ffa"
server_key_iv: "b97d9de0a07b475a37b85717740363c2"
server_key_version: "encryptionkey@0"
I20260807 18:43:19.853042 12717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "411446fa6d454013b6e04bd386117eec"
format_stamp: "Formatted at 2026-08-07 18:43:19 on dist-test-slave-07c2"
server_key: "8b4740b25704e6fbaa6da4347d273ffa"
server_key_iv: "b97d9de0a07b475a37b85717740363c2"
server_key_version: "encryptionkey@0"
I20260807 18:43:19.856644 12717 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:43:19.858888 12734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:19.860049 12717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:19.860183 12717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "411446fa6d454013b6e04bd386117eec"
format_stamp: "Formatted at 2026-08-07 18:43:19 on dist-test-slave-07c2"
server_key: "8b4740b25704e6fbaa6da4347d273ffa"
server_key_iv: "b97d9de0a07b475a37b85717740363c2"
server_key_version: "encryptionkey@0"
I20260807 18:43:19.860304 12717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:19.887004 12717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:19.890307 12717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:19.890513 12717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:19.898495 12717 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:36365
I20260807 18:43:19.898514 12796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:36365 every 8 connection(s)
I20260807 18:43:19.899466 12717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:19.901535 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12717
I20260807 18:43:19.901651 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:19.901988 10939 external_mini_cluster.cc:1428] Setting key a16d6a987d2eccd180478e1e570d15d0
I20260807 18:43:19.902307 12797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:19.909889 12797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Bootstrap starting.
Aug 07 18:43:19 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:19.912436 12797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:19.913399 12797 log.cc:824] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:19.915836 12797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: No bootstrap required, opened a new log
I20260807 18:43:19.918409 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:19.903577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.10.174.254:36365)
0807 18:43:19.903980 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:19.903999 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:19.904040 (+ 41us) server_negotiation.cc:407] Connection header received
0807 18:43:19.904878 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:19.904901 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:19.905413 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:19.905838 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:19.906488 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:19.908168 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:19.909011 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:19.909759 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:19.909943 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:19.912656 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:19.912663 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:19.912683 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:19.912721 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:19.915392 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:19.915799 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:19.915805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:19.915810 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:19.915960 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:19.916230 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:19.916233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:19.916235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:19.916743 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:19.916947 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:19.917136 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 18:43:19.917449 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":114,"threads_started":1}
I20260807 18:43:19.919858 12797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "411446fa6d454013b6e04bd386117eec" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36365 } }
I20260807 18:43:19.920142 12797 raft_consensus.cc:374] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:19.920195 12797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411446fa6d454013b6e04bd386117eec, State: Initialized, Role: FOLLOWER
I20260807 18:43:19.920652 12797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "411446fa6d454013b6e04bd386117eec" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36365 } }
I20260807 18:43:19.920819 12797 raft_consensus.cc:388] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:19.920895 12797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:19.921003 12797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:19.921939 12797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "411446fa6d454013b6e04bd386117eec" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36365 } }
I20260807 18:43:19.922284 12797 leader_election.cc:302] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 411446fa6d454013b6e04bd386117eec; no voters:
I20260807 18:43:19.922587 12797 leader_election.cc:288] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:19.922732 12803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:19.922991 12803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [term 1 LEADER]: Becoming Leader. State: Replica: 411446fa6d454013b6e04bd386117eec, State: Running, Role: LEADER
I20260807 18:43:19.923272 12803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "411446fa6d454013b6e04bd386117eec" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36365 } }
I20260807 18:43:19.923856 12797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:19.924842 12804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "411446fa6d454013b6e04bd386117eec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "411446fa6d454013b6e04bd386117eec" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36365 } } }
I20260807 18:43:19.925030 12804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:19.925017 12805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 411446fa6d454013b6e04bd386117eec. Latest consensus state: current_term: 1 leader_uuid: "411446fa6d454013b6e04bd386117eec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "411446fa6d454013b6e04bd386117eec" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36365 } } }
I20260807 18:43:19.925202 12805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:19.925649 12814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:19.928996 12814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:19.934465 12814 catalog_manager.cc:1347] Generated new cluster ID: 7270ab08bae24c5ca724c5c9af25fbe1
I20260807 18:43:19.934528 12814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:19.949661 12814 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:19.950950 12814 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:19.959751 12814 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Generated new TSK 0
I20260807 18:43:19.960547 12814 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:19.998431 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36365
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:20.112886 12827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:20.113175 12827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:20.113271 12827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:20.117210 12827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:20.117291 12827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:20.117359 12827 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 18:43:20.117405 12827 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:20.117470 12827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:20.122622 12827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:36365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:20.123659 12827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:20.124713 12827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:43:20.133962 12827 server_base.cc:1034] running on GCE node
W20260807 18:43:20.133885 12833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:20.133901 12834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:20.133877 12836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:20.134482 12827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:20.135076 12827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:20.136261 12827 hybrid_clock.cc:648] HybridClock initialized: now 1786128200136235 us; error 42 us; skew 500 ppm
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:20.138911 12827 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:20.139824 12827 webserver.cc:460] Webserver started at http://127.10.174.193:39181/ using document root <none> and password file <none>
I20260807 18:43:20.140363 12827 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:20.140455 12827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:20.140750 12827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:20.142769 12827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "0788944aa7324679ad64aae86faa8353"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "d8e49693e2c9ba5bc7007bb5d471b01a"
server_key_iv: "7223ca302789522e9d9ad5d8a8fb8b19"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.143394 12827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "0788944aa7324679ad64aae86faa8353"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "d8e49693e2c9ba5bc7007bb5d471b01a"
server_key_iv: "7223ca302789522e9d9ad5d8a8fb8b19"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.146845 12827 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:20.149128 12843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.150219 12827 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:20.150367 12827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "0788944aa7324679ad64aae86faa8353"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "d8e49693e2c9ba5bc7007bb5d471b01a"
server_key_iv: "7223ca302789522e9d9ad5d8a8fb8b19"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.150472 12827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:20.159776 12827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:20.162282 12827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:20.162469 12827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:20.164011 12827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:20.164081 12827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.164139 12827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:20.164180 12827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:20.174782 12827 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:35763
I20260807 18:43:20.174844 12962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:35763 every 8 connection(s)
I20260807 18:43:20.175817 12827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:20.177431 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.164650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:38919 (local address 127.10.174.254:36365)
0807 18:43:20.164809 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.164817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.166082 (+ 1265us) server_negotiation.cc:407] Connection header received
0807 18:43:20.167076 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.167081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.167147 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.167274 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.168582 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.169134 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.170363 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.170714 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.170833 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.173436 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.173440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.173442 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.173469 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.175161 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.175706 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.175708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.175709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.175792 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.176168 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.176172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.176174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.176410 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.176509 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.177127 (+ 618us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.177258 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 18:43:20.178066 12852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.165516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.10.174.193:38919)
0807 18:43:20.165929 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.165973 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.166874 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.167489 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.167501 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.167804 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.168423 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.168438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.169263 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.169268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.170218 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.170228 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.170874 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.170879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.171073 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.171654 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.171672 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.173232 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.175249 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.175254 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.175265 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.175608 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.175890 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.175893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.175895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.176049 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.176627 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.176634 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.176895 (+ 261us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.177067 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.177351 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":118,"threads_started":1}
I20260807 18:43:20.179271 12964 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36365
I20260807 18:43:20.179417 12964 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:20.179934 12964 heartbeater.cc:511] Master 127.10.174.254:36365 requested a full tablet report, sending...
I20260807 18:43:20.181399 12750 ts_manager.cc:194] Registered new tserver with Master: 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763)
I20260807 18:43:20.182814 12750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:38919
I20260807 18:43:20.185451 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12827
I20260807 18:43:20.185573 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:20.185897 10939 external_mini_cluster.cc:1428] Setting key f2cebcb9c8e39071ed2a519ffe5b9a30
I20260807 18:43:20.188441 12970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.181315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.10.174.193:51815)
0807 18:43:20.181666 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.181678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.181750 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.181956 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.181958 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.182105 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.182189 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.182193 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.183086 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.183089 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.183707 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.183715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.184184 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.184187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.184287 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.184753 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.184765 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.185064 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.186932 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.186936 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.186938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.187196 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.187515 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.187518 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.187519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.187594 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.188038 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.188040 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.188115 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.188208 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.188307 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260807 18:43:20.188669 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.181424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:51815 (local address 127.10.174.254:36365)
0807 18:43:20.181539 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.181545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.181748 (+ 203us) server_negotiation.cc:407] Connection header received
0807 18:43:20.181824 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.181827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.181864 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.181935 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.182293 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.182974 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.183847 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.184072 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.184178 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.185196 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.185199 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.185202 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.185225 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.186823 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.187327 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.187330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.187332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.187416 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.187691 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.187697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.187699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.187943 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.188047 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.188291 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.188428 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:20.209730 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36365
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:20.317850 12973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:20.318140 12973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:20.318230 12973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:20.322144 12973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:20.322194 12973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:20.322232 12973 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 18:43:20.322247 12973 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:20.322276 12973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:20.327656 12973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:36365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:20.328626 12973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:20.329602 12973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:20.338538 12978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:20.338588 12981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:20.338649 12979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:20.338887 12973 server_base.cc:1034] running on GCE node
I20260807 18:43:20.339341 12973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:20.339892 12973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:20.341046 12973 hybrid_clock.cc:648] HybridClock initialized: now 1786128200341017 us; error 41 us; skew 500 ppm
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:20.343791 12973 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:20.344568 12973 webserver.cc:460] Webserver started at http://127.10.174.194:34245/ using document root <none> and password file <none>
I20260807 18:43:20.345101 12973 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:20.345166 12973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:20.345328 12973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:20.347163 12973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "f02c53606e9442268db2d75758c14bcf"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "8d8d4935f814e09bea817d84e3f8cc20"
server_key_iv: "1edabf2c48772a7064daf77180c147af"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.347745 12973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "f02c53606e9442268db2d75758c14bcf"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "8d8d4935f814e09bea817d84e3f8cc20"
server_key_iv: "1edabf2c48772a7064daf77180c147af"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.351150 12973 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:20.353480 12988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.354737 12973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:20.354853 12973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "f02c53606e9442268db2d75758c14bcf"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "8d8d4935f814e09bea817d84e3f8cc20"
server_key_iv: "1edabf2c48772a7064daf77180c147af"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.354960 12973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:20.378187 12973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:20.381458 12973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:20.381664 12973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:20.383023 12973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:20.383068 12973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.383107 12973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:20.383164 12973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:20.393743 12973 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:45405
I20260807 18:43:20.393827 13107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:45405 every 8 connection(s)
I20260807 18:43:20.394856 12973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:20.395511 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 12973
I20260807 18:43:20.395639 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:20.395964 10939 external_mini_cluster.cc:1428] Setting key a7a7631fd23ecab1c0ab57aec9d2e60a
I20260807 18:43:20.397454 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.383923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:46245 (local address 127.10.174.254:36365)
0807 18:43:20.384074 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.384079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.384856 (+ 777us) server_negotiation.cc:407] Connection header received
0807 18:43:20.385775 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.385778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.385837 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.385926 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.387559 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.388412 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.390248 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.390622 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.390759 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.393404 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.393408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.393410 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.393440 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.395128 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.395766 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.395770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.395772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.395864 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.396241 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.396244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.396245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.396471 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.396583 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.397187 (+ 604us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.397310 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:43:20.398355 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.384260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.10.174.194:46245)
0807 18:43:20.384691 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.384739 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.385575 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.386119 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.386129 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.386635 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.387363 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.387387 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.388560 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.388567 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.390104 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.390117 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.390805 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.390809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.390981 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.391516 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.391531 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.393243 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.395265 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.395272 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.395285 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.395628 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.395953 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.395957 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.395959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.396126 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.396732 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.396737 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.396941 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.397116 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.397426 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":127,"threads_started":1}
I20260807 18:43:20.399624 13108 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36365
I20260807 18:43:20.399791 13108 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:20.400239 13108 heartbeater.cc:511] Master 127.10.174.254:36365 requested a full tablet report, sending...
I20260807 18:43:20.401248 12750 ts_manager.cc:194] Registered new tserver with Master: f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405)
I20260807 18:43:20.402062 12750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:46245
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:20.408792 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.402131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:35337 (local address 127.10.174.254:36365)
0807 18:43:20.402261 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.402266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.402280 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:20.402312 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.402315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.402353 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.402438 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.402933 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.403523 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.404386 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.404611 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.404718 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.405741 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.405745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.405747 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.405771 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.407163 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.407588 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.407593 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.407594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.407679 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.407952 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.407957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.407959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.408155 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.408275 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.408528 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.408648 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:43:20.408807 13116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.401867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.10.174.194:35337)
0807 18:43:20.402115 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.402129 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.402215 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.402453 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.402456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.402690 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.402810 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.402817 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.403643 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.403646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.404266 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.404274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.404730 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.404734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.404831 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.405304 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.405315 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.405592 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.407275 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.407278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.407280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.407489 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.407772 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.407776 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.407778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.407862 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.408268 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.408271 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.408366 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.408473 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.408622 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":18,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:20.424522 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36365
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:20.535580 13118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:20.535811 13118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:20.535857 13118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:20.539863 13118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:20.539932 13118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:20.539973 13118 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 18:43:20.539987 13118 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:20.540019 13118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:20.545224 13118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:36365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:20.546167 13118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:20.547108 13118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:20.556847 13124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:20.556864 13123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:20.556864 13126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:20.557111 13118 server_base.cc:1034] running on GCE node
I20260807 18:43:20.557535 13118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:20.558178 13118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:20.559358 13118 hybrid_clock.cc:648] HybridClock initialized: now 1786128200559319 us; error 44 us; skew 500 ppm
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:20.562151 13118 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:20.563122 13118 webserver.cc:460] Webserver started at http://127.10.174.195:42893/ using document root <none> and password file <none>
I20260807 18:43:20.563737 13118 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:20.563830 13118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:20.564041 13118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:20.566092 13118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "af55444a9921491c8f92c32835bc24e2"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "30e05ca5d9a6e3abd6a8f49e3840b43c"
server_key_iv: "b970664b037cf9f44262c0235ea406f2"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.566679 13118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "af55444a9921491c8f92c32835bc24e2"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "30e05ca5d9a6e3abd6a8f49e3840b43c"
server_key_iv: "b970664b037cf9f44262c0235ea406f2"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.570454 13118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:43:20.572980 13133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.574150 13118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 18:43:20.574293 13118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "af55444a9921491c8f92c32835bc24e2"
format_stamp: "Formatted at 2026-08-07 18:43:20 on dist-test-slave-07c2"
server_key: "30e05ca5d9a6e3abd6a8f49e3840b43c"
server_key_iv: "b970664b037cf9f44262c0235ea406f2"
server_key_version: "encryptionkey@0"
I20260807 18:43:20.574409 13118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:20.587047 13118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:20.591473 13118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:20.591717 13118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:20.593158 13118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:20.593236 13118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.593304 13118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:20.593338 13118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:20.604070 13251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39569 every 8 connection(s)
I20260807 18:43:20.603726 13118 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39569
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:20.605603 13118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:20.610805 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.594336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:41911 (local address 127.10.174.254:36365)
0807 18:43:20.594490 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.594497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.595747 (+ 1250us) server_negotiation.cc:407] Connection header received
0807 18:43:20.597053 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.597057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.597127 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.597193 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.599112 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.600059 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.601888 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.602332 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.602467 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.606183 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.606190 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.606196 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.606235 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.608240 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.608938 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.608943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.608945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.609085 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.609531 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.609535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.609536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.609764 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.609893 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.610494 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.610626 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 18:43:20.611487 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 13118
I20260807 18:43:20.611646 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:20.611764 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.594873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.10.174.195:41911)
0807 18:43:20.595565 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.595630 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.596773 (+ 1143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.597632 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.597645 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.598179 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.598913 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.598932 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.600242 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.600249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.601753 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.601767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.602675 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.602680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.602908 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.603665 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.603695 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.605940 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.608374 (+ 2434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.608379 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.608390 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.608823 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.609191 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.609197 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.609199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.609395 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.609949 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.609956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.610236 (+ 280us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.610445 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.610780 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":143,"threads_started":1}
I20260807 18:43:20.612043 10939 external_mini_cluster.cc:1428] Setting key 1aca768ff38cc981fc82deb4126a9e16
I20260807 18:43:20.615429 13252 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36365
I20260807 18:43:20.615578 13252 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:20.616139 13252 heartbeater.cc:511] Master 127.10.174.254:36365 requested a full tablet report, sending...
I20260807 18:43:20.617249 12750 ts_manager.cc:194] Registered new tserver with Master: af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:20.618100 12750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:41911
I20260807 18:43:20.618631 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:43:20.633164 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.618298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:37337 (local address 127.10.174.254:36365)
0807 18:43:20.618412 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.618416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.619582 (+ 1166us) server_negotiation.cc:407] Connection header received
0807 18:43:20.619757 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.619760 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.619805 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.619857 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.620478 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.621195 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.622451 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.622859 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.622988 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.628934 (+ 5946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.628941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.628948 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.628982 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.630894 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.631510 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.631517 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.631520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.631620 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.631991 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.631997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.632001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.632290 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.632390 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.632792 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.632940 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 18:43:20.634099 13258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.617851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.10.174.195:37337)
0807 18:43:20.619496 (+ 1645us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.619511 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.619650 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.619989 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.619992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.620223 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.620341 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.620348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.621359 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.621364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.622298 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.622311 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.622994 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.622999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.623125 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.628364 (+ 5239us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.628379 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.628748 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.631048 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.631055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.631060 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.631372 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.631756 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.631760 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.631765 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.631870 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.632462 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.632468 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.632583 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.633626 (+ 1043us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.633805 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1565,"thread_start_us":83,"threads_started":1}
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:20.653616 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.644597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35024 (local address 127.10.174.254:36365)
0807 18:43:20.644720 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.644724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.644744 (+ 20us) server_negotiation.cc:407] Connection header received
0807 18:43:20.644784 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.644787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.644824 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.644921 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.645630 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.646357 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.647237 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.647528 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.647653 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.650505 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.650510 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.650512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.650554 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.652153 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.652576 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.652579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.652580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.652655 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.652894 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.652896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.652897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.653069 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.653172 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.653364 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.653466 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 18:43:20.656781 12750 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:20.660043 12750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:20.674484 13274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.668947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.0.0.1:34416)
0807 18:43:20.669478 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.669491 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.669567 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.670269 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.670272 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.670284 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.670438 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.670446 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.671521 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.671528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.673066 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.673077 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.673933 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.673936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.674056 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.674095 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.674213 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.674336 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":79,"thread_start_us":95,"threads_started":1}
I20260807 18:43:20.674494 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.669423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.10.174.195:39569)
0807 18:43:20.669807 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.669823 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.669845 (+ 22us) server_negotiation.cc:407] Connection header received
0807 18:43:20.669921 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.669928 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.670093 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.670418 (+ 325us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.670553 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.671411 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.673209 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.673802 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.673969 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.674112 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.674238 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.674331 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":129,"threads_started":1}
I20260807 18:43:20.674711 13271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.668343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:45405 (local address 127.0.0.1:56918)
0807 18:43:20.669064 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.669078 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.669161 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.670238 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.670244 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.670268 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.670574 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.670584 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.671959 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.671962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.672982 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.672991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.674260 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.674264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.674364 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.674387 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.674456 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.674529 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":83,"thread_start_us":99,"threads_started":1}
I20260807 18:43:20.675118 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.668406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43890 (local address 127.10.174.193:35763)
0807 18:43:20.668795 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.668813 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.669021 (+ 208us) server_negotiation.cc:407] Connection header received
0807 18:43:20.669529 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.669537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.669816 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.669977 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.670308 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.671456 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.673341 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.674091 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.674224 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.674329 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.674892 (+ 563us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.674980 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":72,"threads_started":1}
I20260807 18:43:20.675127 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.669033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56918 (local address 127.10.174.194:45405)
0807 18:43:20.669793 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.669808 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.669829 (+ 21us) server_negotiation.cc:407] Connection header received
0807 18:43:20.669899 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.669902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.670088 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.670241 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.670696 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.671822 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.673108 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.673908 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.674048 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.674181 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.674881 (+ 700us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.675001 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":117,"threads_started":1}
I20260807 18:43:20.675469 13272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.668259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:35763 (local address 127.0.0.1:43890)
0807 18:43:20.668741 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.668793 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.669306 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.669983 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.669989 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.670013 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.670160 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.670170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.671564 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.671567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.673220 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.673228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.674386 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.674389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.674482 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.674500 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.674697 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.675346 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":293,"thread_start_us":59,"threads_started":1}
I20260807 18:43:20.678223 13183 tablet_service.cc:1467] Processing CreateTablet for tablet 69f8500d1e794d149398140e8d454878 (DEFAULT_TABLE table=test-table [id=3b55824916f6417cbe72dd7678287e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:20.678229 12895 tablet_service.cc:1467] Processing CreateTablet for tablet 69f8500d1e794d149398140e8d454878 (DEFAULT_TABLE table=test-table [id=3b55824916f6417cbe72dd7678287e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:20.678229 13039 tablet_service.cc:1467] Processing CreateTablet for tablet 69f8500d1e794d149398140e8d454878 (DEFAULT_TABLE table=test-table [id=3b55824916f6417cbe72dd7678287e62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:20.679365 12895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f8500d1e794d149398140e8d454878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:20.679389 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f8500d1e794d149398140e8d454878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:20.679678 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f8500d1e794d149398140e8d454878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:20.686240 13278 tablet_bootstrap.cc:492] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Bootstrap starting.
I20260807 18:43:20.687793 13279 tablet_bootstrap.cc:492] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Bootstrap starting.
I20260807 18:43:20.688495 13278 tablet_bootstrap.cc:654] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:20.689301 13278 log.cc:824] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:20.690044 13279 tablet_bootstrap.cc:654] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:20.690480 13280 tablet_bootstrap.cc:492] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Bootstrap starting.
I20260807 18:43:20.690826 13279 log.cc:824] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:20.691577 13278 tablet_bootstrap.cc:492] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: No bootstrap required, opened a new log
I20260807 18:43:20.691784 13278 ts_tablet_manager.cc:1397] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:43:20.692674 13280 tablet_bootstrap.cc:654] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:20.693501 13280 log.cc:824] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:20.695416 13280 tablet_bootstrap.cc:492] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: No bootstrap required, opened a new log
I20260807 18:43:20.695564 13279 tablet_bootstrap.cc:492] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: No bootstrap required, opened a new log
I20260807 18:43:20.695627 13280 ts_tablet_manager.cc:1397] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260807 18:43:20.695745 13279 ts_tablet_manager.cc:1397] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 18:43:20.696100 13278 raft_consensus.cc:348] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.696382 13278 raft_consensus.cc:374] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:20.696452 13278 raft_consensus.cc:729] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Initialized, Role: FOLLOWER
I20260807 18:43:20.696919 13278 consensus_queue.cc:260] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.697980 13278 ts_tablet_manager.cc:1428] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:43:20.698382 13252 heartbeater.cc:503] Master 127.10.174.254:36365 was elected leader, sending a full tablet report...
I20260807 18:43:20.698961 13280 raft_consensus.cc:348] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.699273 13280 raft_consensus.cc:374] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:20.699368 13280 raft_consensus.cc:729] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Initialized, Role: FOLLOWER
I20260807 18:43:20.699393 13279 raft_consensus.cc:348] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.699662 13279 raft_consensus.cc:374] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:20.699723 13279 raft_consensus.cc:729] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0788944aa7324679ad64aae86faa8353, State: Initialized, Role: FOLLOWER
I20260807 18:43:20.699864 13280 consensus_queue.cc:260] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.700131 13279 consensus_queue.cc:260] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.700846 13280 ts_tablet_manager.cc:1428] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260807 18:43:20.701074 13279 ts_tablet_manager.cc:1428] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:43:20.701216 13108 heartbeater.cc:503] Master 127.10.174.254:36365 was elected leader, sending a full tablet report...
I20260807 18:43:20.701427 12964 heartbeater.cc:503] Master 127.10.174.254:36365 was elected leader, sending a full tablet report...
I20260807 18:43:20.776702 13286 raft_consensus.cc:482] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:20.776933 13286 raft_consensus.cc:504] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.778122 13286 leader_election.cc:288] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405), af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:20.782719 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.779029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:60813 (local address 127.10.174.195:39569)
0807 18:43:20.779193 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.779198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.779463 (+ 265us) server_negotiation.cc:407] Connection header received
0807 18:43:20.779646 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.779649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.779697 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.779784 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.780071 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.780601 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.781696 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.782114 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.782256 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.782312 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.782498 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.782574 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:43:20.782761 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.778571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:37765 (local address 127.10.174.194:45405)
0807 18:43:20.778748 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.778755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.778967 (+ 212us) server_negotiation.cc:407] Connection header received
0807 18:43:20.779214 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.779220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.779267 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.779367 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.779895 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.780541 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.781737 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.782129 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.782270 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.782320 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.782554 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.782638 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:43:20.782747 13288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.778928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.10.174.193:60813)
0807 18:43:20.779352 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.779369 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.779471 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.779804 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.779806 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.779820 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.779964 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.779971 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.780738 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.780741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.781561 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.781570 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.782262 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.782265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.782370 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.782389 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.782450 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.782535 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":152,"threads_started":1}
I20260807 18:43:20.783180 13287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.778415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:45405 (local address 127.10.174.193:37765)
0807 18:43:20.778856 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.778875 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.779055 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.779581 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.779584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.779624 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.779772 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.779782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.780704 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.780710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.781572 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.781582 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.782275 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.782279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.782390 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.782419 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.782516 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.782581 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":45,"thread_start_us":154,"threads_started":1}
I20260807 18:43:20.783509 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f8500d1e794d149398140e8d454878" candidate_uuid: "0788944aa7324679ad64aae86faa8353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af55444a9921491c8f92c32835bc24e2" is_pre_election: true
I20260807 18:43:20.783816 13060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f8500d1e794d149398140e8d454878" candidate_uuid: "0788944aa7324679ad64aae86faa8353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02c53606e9442268db2d75758c14bcf" is_pre_election: true
I20260807 18:43:20.783856 13204 raft_consensus.cc:2454] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0788944aa7324679ad64aae86faa8353 in term 0.
I20260807 18:43:20.784080 13060 raft_consensus.cc:2454] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0788944aa7324679ad64aae86faa8353 in term 0.
I20260807 18:43:20.784403 12845 leader_election.cc:302] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, af55444a9921491c8f92c32835bc24e2; no voters:
I20260807 18:43:20.784699 13286 raft_consensus.cc:2781] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:20.784801 13286 raft_consensus.cc:482] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:20.784850 13286 raft_consensus.cc:3037] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:20.785897 13286 raft_consensus.cc:504] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.786237 13286 leader_election.cc:288] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [CANDIDATE]: Term 1 election: Requested vote from peers f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405), af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:20.786630 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f8500d1e794d149398140e8d454878" candidate_uuid: "0788944aa7324679ad64aae86faa8353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af55444a9921491c8f92c32835bc24e2"
I20260807 18:43:20.786631 13060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f8500d1e794d149398140e8d454878" candidate_uuid: "0788944aa7324679ad64aae86faa8353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02c53606e9442268db2d75758c14bcf"
I20260807 18:43:20.786764 13060 raft_consensus.cc:3037] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:20.786754 13204 raft_consensus.cc:3037] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:20.788100 13060 raft_consensus.cc:2454] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0788944aa7324679ad64aae86faa8353 in term 1.
I20260807 18:43:20.788100 13204 raft_consensus.cc:2454] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0788944aa7324679ad64aae86faa8353 in term 1.
I20260807 18:43:20.788416 12845 leader_election.cc:302] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, af55444a9921491c8f92c32835bc24e2; no voters:
I20260807 18:43:20.788609 13286 raft_consensus.cc:2781] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:20.788841 13286 raft_consensus.cc:686] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 1 LEADER]: Becoming Leader. State: Replica: 0788944aa7324679ad64aae86faa8353, State: Running, Role: LEADER
I20260807 18:43:20.789158 13286 consensus_queue.cc:237] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.792520 12749 catalog_manager.cc:5495] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0788944aa7324679ad64aae86faa8353 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "0788944aa7324679ad64aae86faa8353" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } health_report { overall_health: UNKNOWN } } }
Aug 07 18:43:20 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128199, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:20.853006 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.845024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35030 (local address 127.10.174.254:36365)
0807 18:43:20.845181 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.845186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.845338 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:43:20.845439 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.845441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.845481 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.845550 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:20.846166 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.846664 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.847477 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.847678 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.847764 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.849875 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:20.849878 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:20.849880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:20.849901 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:20.851275 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.851851 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.851853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.851855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.851927 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:20.852236 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:20.852239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:20.852240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:20.852399 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:20.852473 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.852757 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.852882 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":79}
I20260807 18:43:20.853019 13296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.844940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36365 (local address 127.0.0.1:35030)
0807 18:43:20.845249 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.845262 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.845361 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.845583 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.845585 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.845965 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:20.846064 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.846070 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.846750 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.846753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.847377 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.847386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.847769 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.847771 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.847832 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.848359 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:20.848371 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:20.849746 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:20.851430 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.851443 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.851453 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.851764 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.852037 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:20.852039 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:20.852041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:20.852143 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:20.852495 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:20.852501 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:20.852606 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.852700 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.852825 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":128,"threads_started":1}
I20260807 18:43:20.857103 12749 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:35030:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 18:43:20.857892 12749 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 18:43:20.857959 13253 tablet.cc:2369] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:20.862869 13183 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc4df3ee9cb495298d7f33a3753534d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3ea9987a38843768e461eb6b575e9e8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:20.862856 13039 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc4df3ee9cb495298d7f33a3753534d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3ea9987a38843768e461eb6b575e9e8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:20.862828 12895 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc4df3ee9cb495298d7f33a3753534d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3ea9987a38843768e461eb6b575e9e8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:20.863607 12895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc4df3ee9cb495298d7f33a3753534d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:20.863612 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc4df3ee9cb495298d7f33a3753534d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:20.863612 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc4df3ee9cb495298d7f33a3753534d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:20.866389 13279 tablet_bootstrap.cc:492] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: Bootstrap starting.
I20260807 18:43:20.866549 13280 tablet_bootstrap.cc:492] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: Bootstrap starting.
I20260807 18:43:20.866765 13278 tablet_bootstrap.cc:492] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: Bootstrap starting.
I20260807 18:43:20.867384 13279 tablet_bootstrap.cc:654] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:20.867848 13278 tablet_bootstrap.cc:654] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:20.867918 13280 tablet_bootstrap.cc:654] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:20.869128 13279 tablet_bootstrap.cc:492] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: No bootstrap required, opened a new log
I20260807 18:43:20.869234 13279 ts_tablet_manager.cc:1397] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 18:43:20.869379 13278 tablet_bootstrap.cc:492] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: No bootstrap required, opened a new log
I20260807 18:43:20.869469 13278 ts_tablet_manager.cc:1397] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 18:43:20.869593 13280 tablet_bootstrap.cc:492] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: No bootstrap required, opened a new log
I20260807 18:43:20.869686 13280 ts_tablet_manager.cc:1397] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 18:43:20.869771 13279 raft_consensus.cc:348] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.869896 13279 raft_consensus.cc:374] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:20.869937 13279 raft_consensus.cc:729] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0788944aa7324679ad64aae86faa8353, State: Initialized, Role: FOLLOWER
I20260807 18:43:20.869961 13278 raft_consensus.cc:348] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.870097 13278 raft_consensus.cc:374] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:20.870074 13279 consensus_queue.cc:260] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.870151 13278 raft_consensus.cc:729] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Initialized, Role: FOLLOWER
I20260807 18:43:20.870118 13280 raft_consensus.cc:348] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.870232 13280 raft_consensus.cc:374] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:20.870281 13280 raft_consensus.cc:729] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Initialized, Role: FOLLOWER
I20260807 18:43:20.870339 13278 consensus_queue.cc:260] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.870345 13286 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:20.870400 13280 consensus_queue.cc:260] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.870469 13286 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:20.870585 13284 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:20.870682 13280 ts_tablet_manager.cc:1428] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:20.870719 13284 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:20.870882 13285 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:20.871003 13285 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:20.871088 13279 ts_tablet_manager.cc:1428] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 18:43:20.871830 13278 ts_tablet_manager.cc:1428] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260807 18:43:20.896292 13109 tablet.cc:2369] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:43:20.927189 12965 tablet.cc:2369] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:20.991199 13284 raft_consensus.cc:482] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:20.991391 13284 raft_consensus.cc:504] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.992587 13284 leader_election.cc:288] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405)
I20260807 18:43:20.996227 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.992842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:45405 (local address 127.10.174.195:43869)
0807 18:43:20.992994 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.993011 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.993138 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.993459 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.993462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.993482 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.993599 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.993605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.994336 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.994341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.995104 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.995112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.995804 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.995808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.995917 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.995935 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.996023 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.996096 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 18:43:20.996227 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.992955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:43869 (local address 127.10.174.194:45405)
0807 18:43:20.993099 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.993104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.993122 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:43:20.993280 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.993283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.993336 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.993448 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.993714 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.994214 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.995232 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.995678 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.995808 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.995862 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.996038 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.996105 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:43:20.996781 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.993029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:40927 (local address 127.10.174.193:35763)
0807 18:43:20.993186 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:20.993192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:20.993513 (+ 321us) server_negotiation.cc:407] Connection header received
0807 18:43:20.993666 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:20.993669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:20.993716 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:20.993796 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:20.994064 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.994598 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.995669 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.996063 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.996205 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.996252 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:20.996606 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 18:43:20.996675 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 18:43:20.996807 13300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:20.992842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:35763 (local address 127.10.174.195:40927)
0807 18:43:20.993424 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:20.993435 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:20.993549 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:20.993809 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:20.993812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:20.993827 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:20.993956 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.993961 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.994714 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.994718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.995550 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:20.995559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:20.996201 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:20.996205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:20.996475 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:20.996510 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 18:43:20.996579 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 18:43:20.996648 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":238,"thread_start_us":141,"threads_started":1}
I20260807 18:43:20.996912 13060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc4df3ee9cb495298d7f33a3753534d" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02c53606e9442268db2d75758c14bcf" is_pre_election: true
I20260807 18:43:20.997090 13060 raft_consensus.cc:2454] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 0.
I20260807 18:43:20.997474 13135 leader_election.cc:302] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af55444a9921491c8f92c32835bc24e2, f02c53606e9442268db2d75758c14bcf; no voters:
I20260807 18:43:20.997545 12897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc4df3ee9cb495298d7f33a3753534d" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353" is_pre_election: true
I20260807 18:43:20.997742 12897 raft_consensus.cc:2454] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 0.
I20260807 18:43:20.997779 13284 raft_consensus.cc:2781] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:20.997857 13284 raft_consensus.cc:482] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:20.997915 13284 raft_consensus.cc:3037] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:20.998935 13284 raft_consensus.cc:504] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:20.999274 13284 leader_election.cc:288] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 election: Requested vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405)
I20260807 18:43:20.999641 13060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc4df3ee9cb495298d7f33a3753534d" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02c53606e9442268db2d75758c14bcf"
I20260807 18:43:20.999640 12897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc4df3ee9cb495298d7f33a3753534d" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353"
I20260807 18:43:20.999763 12897 raft_consensus.cc:3037] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:20.999763 13060 raft_consensus.cc:3037] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:21.000900 12897 raft_consensus.cc:2454] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 1.
I20260807 18:43:21.000900 13060 raft_consensus.cc:2454] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 1.
I20260807 18:43:21.001178 13137 leader_election.cc:302] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, af55444a9921491c8f92c32835bc24e2; no voters:
I20260807 18:43:21.001348 13284 raft_consensus.cc:2781] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:21.001559 13284 raft_consensus.cc:686] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [term 1 LEADER]: Becoming Leader. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Running, Role: LEADER
I20260807 18:43:21.001873 13284 consensus_queue.cc:237] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.004043 13301 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: TxnStatusTablet state changed. Reason: New leader af55444a9921491c8f92c32835bc24e2. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.004165 13301 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:21.004467 13304 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 18:43:21.004691 13304 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 18:43:21.005110 12749 catalog_manager.cc:5495] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to af55444a9921491c8f92c32835bc24e2 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } health_report { overall_health: HEALTHY } } }
I20260807 18:43:21.023178 13296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.019454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.0.0.1:34432)
0807 18:43:21.019694 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.019715 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.019799 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.020195 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.020198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.020205 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:21.020315 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.020320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.021044 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.021048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.021643 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.021651 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.022100 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.022104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.022199 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.022240 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.022878 (+ 638us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.022896 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.022967 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.023049 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260807 18:43:21.023182 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.019582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34432 (local address 127.10.174.195:39569)
0807 18:43:21.019952 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.019956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.019966 (+ 10us) server_negotiation.cc:407] Connection header received
0807 18:43:21.020017 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.020019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.020064 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.020168 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.020426 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.020925 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.021765 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.021986 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.022096 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.022390 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.022775 (+ 385us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.022898 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.022977 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.023026 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294}
I20260807 18:43:21.028661 13060 raft_consensus.cc:1261] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Refusing update from remote peer af55444a9921491c8f92c32835bc24e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:21.028661 12897 raft_consensus.cc:1261] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Refusing update from remote peer af55444a9921491c8f92c32835bc24e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:21.029333 13301 consensus_queue.cc:1035] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:21.029536 13284 consensus_queue.cc:1035] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:21.032881 13286 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: TxnStatusTablet state changed. Reason: New leader af55444a9921491c8f92c32835bc24e2. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.033015 13286 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:21.034035 13285 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: TxnStatusTablet state changed. Reason: New leader af55444a9921491c8f92c32835bc24e2. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.034152 13285 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:21.035703 13301 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.035811 13301 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:21.038487 13286 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.038597 13286 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P 0788944aa7324679ad64aae86faa8353: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:21.039929 13284 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.040059 13284 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P af55444a9921491c8f92c32835bc24e2: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:21.042881 13285 tablet_replica.cc:439] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } } }
I20260807 18:43:21.042999 13285 tablet_replica.cc:442] T 8dc4df3ee9cb495298d7f33a3753534d P f02c53606e9442268db2d75758c14bcf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:21.043975 13309 mvcc.cc:205] Tried to move back new op lower bound from 7315981111405998080 to 7315981111306108928. Current Snapshot: MvccSnapshot[applied={T|T < 7315981111405998080 or (T in {7315981111405998080})}]
I20260807 18:43:21.048895 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.044892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43902 (local address 127.10.174.193:35763)
0807 18:43:21.045263 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.045266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.045276 (+ 10us) server_negotiation.cc:407] Connection header received
0807 18:43:21.045330 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.045333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.045374 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.045449 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.045748 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.046220 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.047498 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.047694 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.047769 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.048065 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.048502 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.048626 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.048723 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.048773 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303}
I20260807 18:43:21.059351 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.055749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:36365 (local address 127.10.174.195:39569)
0807 18:43:21.055889 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.055893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.056063 (+ 170us) server_negotiation.cc:407] Connection header received
0807 18:43:21.056224 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.056227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.056276 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.056359 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.056621 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.057122 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.058152 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.058384 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.058493 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.058853 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.058937 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.059016 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.059112 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.059179 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 18:43:21.059386 13320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.055664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.10.174.193:36365)
0807 18:43:21.055972 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.055984 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.056102 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.056378 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.056381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.056389 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:21.056509 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.056514 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.057240 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.057244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.057999 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.058008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.058495 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.058498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.058598 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.058638 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.059026 (+ 388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.059032 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.059083 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.059183 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":90,"threads_started":1}
I20260807 18:43:21.066130 13060 raft_consensus.cc:1261] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Refusing update from remote peer 0788944aa7324679ad64aae86faa8353: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:21.066356 13204 raft_consensus.cc:1261] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Refusing update from remote peer 0788944aa7324679ad64aae86faa8353: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:21.066577 13286 consensus_queue.cc:1035] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:21.066838 13289 consensus_queue.cc:1035] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:21.070981 13308 mvcc.cc:205] Tried to move back new op lower bound from 7315981111562993664 to 7315981110435164160. Current Snapshot: MvccSnapshot[applied={T|T < 7315981111562993664}]
I20260807 18:43:21.092514 13258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.088916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:35763 (local address 127.10.174.195:43019)
0807 18:43:21.089081 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.089097 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.089191 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.089412 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.089415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.089424 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:21.089541 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.089547 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.090452 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.090456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.091266 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.091280 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.091800 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.091804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.091904 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.091944 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.092240 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.092249 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.092310 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.092390 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 18:43:21.092514 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.088988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:43019 (local address 127.10.174.193:35763)
0807 18:43:21.089087 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.089094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.089142 (+ 48us) server_negotiation.cc:407] Connection header received
0807 18:43:21.089289 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.089291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.089329 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.089381 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.089626 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.090343 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.091435 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.091681 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.091791 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.092076 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.092156 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.092235 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.092329 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.092380 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 18:43:21.115553 12751 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:21.115747 12751 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:21.118239 12751 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Sending DeleteTablet for 3 replicas of tablet 69f8500d1e794d149398140e8d454878
I20260807 18:43:21.118932 12895 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f8500d1e794d149398140e8d454878 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:21 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:43890
I20260807 18:43:21.119153 13039 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f8500d1e794d149398140e8d454878 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:21 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:56918
I20260807 18:43:21.119556 13328 tablet_replica.cc:330] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: stopping tablet replica
I20260807 18:43:21.120041 13328 raft_consensus.cc:2229] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:21.120442 13328 raft_consensus.cc:2258] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:21.120623 13183 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f8500d1e794d149398140e8d454878 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:21 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:34416
I20260807 18:43:21.120653 12751 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:21.121022 12751 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:21.121846 13329 tablet_replica.cc:330] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: stopping tablet replica
I20260807 18:43:21.122128 13329 raft_consensus.cc:2229] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:21.122332 13329 raft_consensus.cc:2258] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:21.123767 13328 ts_tablet_manager.cc:1905] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:21.127811 13328 ts_tablet_manager.cc:1918] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:21.127974 13328 log.cc:1196] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/69f8500d1e794d149398140e8d454878
I20260807 18:43:21.128604 13183 tablet_service.cc:1467] Processing CreateTablet for tablet 88f92dd731e745ef8d46d111297db652 (DEFAULT_TABLE table=test-table [id=fe4b75ad526b44ae831df443f286548b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:21.128618 13039 tablet_service.cc:1467] Processing CreateTablet for tablet 88f92dd731e745ef8d46d111297db652 (DEFAULT_TABLE table=test-table [id=fe4b75ad526b44ae831df443f286548b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:21.128880 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88f92dd731e745ef8d46d111297db652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:21.128887 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88f92dd731e745ef8d46d111297db652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:21.131212 13278 tablet_bootstrap.cc:492] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Bootstrap starting.
I20260807 18:43:21.131319 13280 tablet_bootstrap.cc:492] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Bootstrap starting.
I20260807 18:43:21.132205 13278 tablet_bootstrap.cc:654] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:21.132272 13280 tablet_bootstrap.cc:654] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:21.132992 13329 ts_tablet_manager.cc:1905] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:21.133255 13330 tablet_replica.cc:330] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: stopping tablet replica
I20260807 18:43:21.128286 12895 tablet_service.cc:1467] Processing CreateTablet for tablet 88f92dd731e745ef8d46d111297db652 (DEFAULT_TABLE table=test-table [id=fe4b75ad526b44ae831df443f286548b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:21.133517 12895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88f92dd731e745ef8d46d111297db652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:21.135727 13279 tablet_bootstrap.cc:492] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Bootstrap starting.
I20260807 18:43:21.136529 13329 ts_tablet_manager.cc:1918] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:21.136613 13329 log.cc:1196] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/69f8500d1e794d149398140e8d454878
I20260807 18:43:21.136680 13279 tablet_bootstrap.cc:654] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:21.136922 13329 ts_tablet_manager.cc:1939] T 69f8500d1e794d149398140e8d454878 P f02c53606e9442268db2d75758c14bcf: Deleting consensus metadata
I20260807 18:43:21.137686 13328 ts_tablet_manager.cc:1939] T 69f8500d1e794d149398140e8d454878 P 0788944aa7324679ad64aae86faa8353: Deleting consensus metadata
I20260807 18:43:21.138020 13330 raft_consensus.cc:2229] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:21.139180 12738 catalog_manager.cc:4841] TS 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763): tablet 69f8500d1e794d149398140e8d454878 (table test-table [id=3b55824916f6417cbe72dd7678287e62]) successfully deleted
I20260807 18:43:21.139237 13330 raft_consensus.cc:2258] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:21.139417 12736 catalog_manager.cc:4841] TS f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405): tablet 69f8500d1e794d149398140e8d454878 (table test-table [id=3b55824916f6417cbe72dd7678287e62]) successfully deleted
I20260807 18:43:21.140359 13280 tablet_bootstrap.cc:492] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: No bootstrap required, opened a new log
I20260807 18:43:21.140453 13280 ts_tablet_manager.cc:1397] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 18:43:21.140909 13330 ts_tablet_manager.cc:1905] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:21.140895 13280 raft_consensus.cc:348] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.141016 13280 raft_consensus.cc:374] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:21.141055 13280 raft_consensus.cc:729] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Initialized, Role: FOLLOWER
I20260807 18:43:21.141173 13280 consensus_queue.cc:260] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.141487 13280 ts_tablet_manager.cc:1428] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 18:43:21.143815 13279 tablet_bootstrap.cc:492] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: No bootstrap required, opened a new log
I20260807 18:43:21.143903 13279 ts_tablet_manager.cc:1397] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260807 18:43:21.144356 13279 raft_consensus.cc:348] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.144459 13279 raft_consensus.cc:374] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:21.144488 13279 raft_consensus.cc:729] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0788944aa7324679ad64aae86faa8353, State: Initialized, Role: FOLLOWER
I20260807 18:43:21.144598 13279 consensus_queue.cc:260] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.144843 13279 ts_tablet_manager.cc:1428] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:21.147675 13278 tablet_bootstrap.cc:492] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: No bootstrap required, opened a new log
I20260807 18:43:21.147760 13278 ts_tablet_manager.cc:1397] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260807 18:43:21.148185 13278 raft_consensus.cc:348] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.148293 13278 raft_consensus.cc:374] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:21.148324 13278 raft_consensus.cc:729] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Initialized, Role: FOLLOWER
I20260807 18:43:21.148444 13278 consensus_queue.cc:260] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.148696 13278 ts_tablet_manager.cc:1428] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:21.149685 13330 ts_tablet_manager.cc:1918] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:21.149827 13330 log.cc:1196] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/69f8500d1e794d149398140e8d454878
I20260807 18:43:21.150230 13330 ts_tablet_manager.cc:1939] T 69f8500d1e794d149398140e8d454878 P af55444a9921491c8f92c32835bc24e2: Deleting consensus metadata
I20260807 18:43:21.151398 12736 catalog_manager.cc:4841] TS af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569): tablet 69f8500d1e794d149398140e8d454878 (table test-table [id=3b55824916f6417cbe72dd7678287e62]) successfully deleted
I20260807 18:43:21.453404 13285 raft_consensus.cc:482] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:21.453545 13285 raft_consensus.cc:504] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.454701 13285 leader_election.cc:288] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:21.458727 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.455165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:53831 (local address 127.10.174.193:35763)
0807 18:43:21.455328 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.455335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.455581 (+ 246us) server_negotiation.cc:407] Connection header received
0807 18:43:21.455742 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.455744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.455785 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.455870 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:21.456128 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.456616 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.457739 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.458118 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.458280 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.458341 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.458528 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.458597 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:21.458776 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.455139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:46155 (local address 127.10.174.195:39569)
0807 18:43:21.455315 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.455321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.455519 (+ 198us) server_negotiation.cc:407] Connection header received
0807 18:43:21.455699 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.455702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.455746 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.455827 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:21.456109 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.456599 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.457733 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.458175 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.458299 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.458351 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.458580 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.458646 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:21.458770 13336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.455016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:35763 (local address 127.10.174.194:53831)
0807 18:43:21.455467 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.455479 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.455623 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.455880 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.455883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.455920 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:21.456024 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.456029 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.456724 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.456729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.457617 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.457626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.458273 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.458277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.458395 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.458417 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.458511 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.458578 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":123,"spinlock_wait_cycles":1408,"thread_start_us":81,"threads_started":1}
I20260807 18:43:21.458798 13335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.455016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.10.174.194:46155)
0807 18:43:21.455409 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.455421 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.455568 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.455850 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.455852 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.455869 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:21.455994 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.455999 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.456719 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.456725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.457599 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.457608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.458295 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.458298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.458457 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.458475 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.458563 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.458632 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":3,"spinlock_wait_cycles":9344,"thread_start_us":74,"threads_started":1}
I20260807 18:43:21.459477 12897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88f92dd731e745ef8d46d111297db652" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353" is_pre_election: true
I20260807 18:43:21.459477 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88f92dd731e745ef8d46d111297db652" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af55444a9921491c8f92c32835bc24e2" is_pre_election: true
I20260807 18:43:21.459627 13204 raft_consensus.cc:2454] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 0.
I20260807 18:43:21.459627 12897 raft_consensus.cc:2454] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 0.
I20260807 18:43:21.459985 12990 leader_election.cc:302] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, af55444a9921491c8f92c32835bc24e2, f02c53606e9442268db2d75758c14bcf; no voters:
I20260807 18:43:21.460283 13285 raft_consensus.cc:2781] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:21.460355 13285 raft_consensus.cc:482] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:21.460408 13285 raft_consensus.cc:3037] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:21.461567 13285 raft_consensus.cc:504] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.461887 13285 leader_election.cc:288] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 election: Requested vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:21.462225 12897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88f92dd731e745ef8d46d111297db652" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353"
I20260807 18:43:21.462265 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88f92dd731e745ef8d46d111297db652" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af55444a9921491c8f92c32835bc24e2"
I20260807 18:43:21.462324 12897 raft_consensus.cc:3037] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:21.462407 13204 raft_consensus.cc:3037] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:21.463227 12897 raft_consensus.cc:2454] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 1.
I20260807 18:43:21.463510 13204 raft_consensus.cc:2454] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 1.
I20260807 18:43:21.463543 12992 leader_election.cc:302] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, f02c53606e9442268db2d75758c14bcf; no voters:
I20260807 18:43:21.463721 13285 raft_consensus.cc:2781] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:21.463930 13285 raft_consensus.cc:686] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 1 LEADER]: Becoming Leader. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Running, Role: LEADER
I20260807 18:43:21.464349 13285 consensus_queue.cc:237] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:21.466667 12751 catalog_manager.cc:5495] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to f02c53606e9442268db2d75758c14bcf (127.10.174.194). New cstate: current_term: 1 leader_uuid: "f02c53606e9442268db2d75758c14bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:21.504196 13340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.500716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56934 (local address 127.10.174.194:45405)
0807 18:43:21.500932 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.500938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.500953 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:43:21.501033 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.501035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.501083 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.501208 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.501443 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.501954 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.502755 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.502984 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.503093 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.503376 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.503812 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.503939 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.503998 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.504050 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":58,"threads_started":1}
I20260807 18:43:21.513444 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.510647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:40229 (local address 127.10.174.195:39569)
0807 18:43:21.510764 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.510767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.510895 (+ 128us) server_negotiation.cc:407] Connection header received
0807 18:43:21.510978 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.510980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.511019 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.511080 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.511352 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.511827 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.512605 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.512811 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.512883 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.513119 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.513178 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.513228 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.513307 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.513344 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 18:43:21.513481 13343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.510550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.10.174.194:40229)
0807 18:43:21.510820 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.510833 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.510915 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.511102 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.511104 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.511110 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:21.511209 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.511212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.511917 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.511919 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.512511 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.512519 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.512902 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.512905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.512973 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.513012 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.513247 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.513251 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.513299 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.513356 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":100,"threads_started":1}
I20260807 18:43:21.518815 12897 raft_consensus.cc:1261] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Refusing update from remote peer f02c53606e9442268db2d75758c14bcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:21.518957 13204 raft_consensus.cc:1261] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Refusing update from remote peer f02c53606e9442268db2d75758c14bcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:21.519357 13337 consensus_queue.cc:1035] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:21.519546 13285 consensus_queue.cc:1035] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:21.537031 13340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.533653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:41265 (local address 127.10.174.194:45405)
0807 18:43:21.533765 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:21.533770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:21.533820 (+ 50us) server_negotiation.cc:407] Connection header received
0807 18:43:21.533954 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:21.533957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:21.533999 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:21.534081 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:21.534317 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.534912 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.535791 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.536018 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.536128 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.536518 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.536597 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.536677 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:21.536845 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 18:43:21.536900 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 18:43:21.537046 13258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:21.533604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:45405 (local address 127.10.174.195:41265)
0807 18:43:21.533763 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:21.533779 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:21.533862 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:21.534103 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:21.534106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:21.534113 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:21.534204 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.534209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.535017 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.535022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.535667 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:21.535676 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:21.536127 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:21.536130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:21.536214 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:21.536252 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:21.536718 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:21.536726 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 18:43:21.536831 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 18:43:21.536907 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
W20260807 18:43:21.537807 13308 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 18:43:23.105435 12750 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:23.105597 12750 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:23.108083 12750 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Sending DeleteTablet for 3 replicas of tablet 88f92dd731e745ef8d46d111297db652
I20260807 18:43:23.108664 12895 tablet_service.cc:1514] Processing DeleteTablet for tablet 88f92dd731e745ef8d46d111297db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:23 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:43890
I20260807 18:43:23.108721 13039 tablet_service.cc:1514] Processing DeleteTablet for tablet 88f92dd731e745ef8d46d111297db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:23 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:56918
I20260807 18:43:23.108985 13183 tablet_service.cc:1514] Processing DeleteTablet for tablet 88f92dd731e745ef8d46d111297db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:23 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:34416
I20260807 18:43:23.109050 13372 tablet_replica.cc:330] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: stopping tablet replica
I20260807 18:43:23.109057 13371 tablet_replica.cc:330] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: stopping tablet replica
I20260807 18:43:23.109189 13372 raft_consensus.cc:2229] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:23.109339 13371 raft_consensus.cc:2229] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:23.109462 13371 raft_consensus.cc:2258] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:23.109529 13372 raft_consensus.cc:2258] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:23.110272 13372 ts_tablet_manager.cc:1905] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:23.112317 13373 tablet_replica.cc:330] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: stopping tablet replica
I20260807 18:43:23.112475 13373 raft_consensus.cc:2229] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:23.112610 13373 raft_consensus.cc:2258] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:23.113296 13373 ts_tablet_manager.cc:1905] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:23.113325 13371 ts_tablet_manager.cc:1905] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:23.113946 13372 ts_tablet_manager.cc:1918] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 18:43:23.114027 13372 log.cc:1196] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/88f92dd731e745ef8d46d111297db652
I20260807 18:43:23.114464 13372 ts_tablet_manager.cc:1939] T 88f92dd731e745ef8d46d111297db652 P f02c53606e9442268db2d75758c14bcf: Deleting consensus metadata
I20260807 18:43:23.115321 12736 catalog_manager.cc:4841] TS f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405): tablet 88f92dd731e745ef8d46d111297db652 (table test-table [id=fe4b75ad526b44ae831df443f286548b]) successfully deleted
I20260807 18:43:23.116025 13371 ts_tablet_manager.cc:1918] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 18:43:23.116117 13371 log.cc:1196] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/88f92dd731e745ef8d46d111297db652
I20260807 18:43:23.116472 13371 ts_tablet_manager.cc:1939] T 88f92dd731e745ef8d46d111297db652 P 0788944aa7324679ad64aae86faa8353: Deleting consensus metadata
I20260807 18:43:23.116798 13373 ts_tablet_manager.cc:1918] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 18:43:23.116897 13373 log.cc:1196] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/88f92dd731e745ef8d46d111297db652
I20260807 18:43:23.117147 12738 catalog_manager.cc:4841] TS 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763): tablet 88f92dd731e745ef8d46d111297db652 (table test-table [id=fe4b75ad526b44ae831df443f286548b]) successfully deleted
I20260807 18:43:23.117231 13373 ts_tablet_manager.cc:1939] T 88f92dd731e745ef8d46d111297db652 P af55444a9921491c8f92c32835bc24e2: Deleting consensus metadata
I20260807 18:43:23.117939 12736 catalog_manager.cc:4841] TS af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569): tablet 88f92dd731e745ef8d46d111297db652 (table test-table [id=fe4b75ad526b44ae831df443f286548b]) successfully deleted
Aug 07 18:43:23 dist-test-slave-07c2 krb5kdc[12703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128203, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 18:43:23 dist-test-slave-07c2 krb5kdc[12703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128203, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:23.141259 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:23.132081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35034 (local address 127.10.174.254:36365)
0807 18:43:23.132387 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:23.132397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:23.132575 (+ 178us) server_negotiation.cc:407] Connection header received
0807 18:43:23.132775 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:23.132781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:23.132830 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:23.133009 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:23.133717 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.134265 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.135136 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.135478 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.135590 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:23.137977 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:23.137980 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:23.137982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:23.138006 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:23.139590 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:23.139963 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:23.139965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:23.139966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:23.140046 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:23.140319 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:23.140321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:23.140323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:23.140494 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:23.140596 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:23.140928 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 18:43:23.141030 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":104,"threads_started":1}
I20260807 18:43:23.144043 12750 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35034:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:23.144495 12750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:23.149260 12895 tablet_service.cc:1467] Processing CreateTablet for tablet 7db20b454c9d4736a17d4175113e3ba6 (DEFAULT_TABLE table=test-table [id=58daacccf4454231a302e16057148470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:23.149468 13183 tablet_service.cc:1467] Processing CreateTablet for tablet 7db20b454c9d4736a17d4175113e3ba6 (DEFAULT_TABLE table=test-table [id=58daacccf4454231a302e16057148470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:23.149590 12895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db20b454c9d4736a17d4175113e3ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:23.149518 13039 tablet_service.cc:1467] Processing CreateTablet for tablet 7db20b454c9d4736a17d4175113e3ba6 (DEFAULT_TABLE table=test-table [id=58daacccf4454231a302e16057148470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:23.149753 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db20b454c9d4736a17d4175113e3ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:23.149868 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db20b454c9d4736a17d4175113e3ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:23.152499 13382 tablet_bootstrap.cc:492] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Bootstrap starting.
I20260807 18:43:23.152796 13383 tablet_bootstrap.cc:492] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Bootstrap starting.
I20260807 18:43:23.153469 13382 tablet_bootstrap.cc:654] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:23.153730 13383 tablet_bootstrap.cc:654] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:23.154422 13385 tablet_bootstrap.cc:492] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Bootstrap starting.
I20260807 18:43:23.154726 13382 tablet_bootstrap.cc:492] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: No bootstrap required, opened a new log
I20260807 18:43:23.154845 13382 ts_tablet_manager.cc:1397] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:23.154994 13383 tablet_bootstrap.cc:492] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: No bootstrap required, opened a new log
I20260807 18:43:23.155088 13383 ts_tablet_manager.cc:1397] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:23.155344 13382 raft_consensus.cc:348] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.155489 13382 raft_consensus.cc:374] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:23.155535 13382 raft_consensus.cc:729] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Initialized, Role: FOLLOWER
I20260807 18:43:23.155499 13383 raft_consensus.cc:348] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.155646 13383 raft_consensus.cc:374] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:23.155690 13383 raft_consensus.cc:729] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0788944aa7324679ad64aae86faa8353, State: Initialized, Role: FOLLOWER
I20260807 18:43:23.155669 13382 consensus_queue.cc:260] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.155836 13383 consensus_queue.cc:260] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.155959 13382 ts_tablet_manager.cc:1428] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:23.156193 13383 ts_tablet_manager.cc:1428] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 18:43:23.156970 13385 tablet_bootstrap.cc:654] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:23.158116 13385 tablet_bootstrap.cc:492] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: No bootstrap required, opened a new log
I20260807 18:43:23.158202 13385 ts_tablet_manager.cc:1397] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 18:43:23.158625 13385 raft_consensus.cc:348] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.158744 13385 raft_consensus.cc:374] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:23.158795 13385 raft_consensus.cc:729] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Initialized, Role: FOLLOWER
I20260807 18:43:23.158937 13385 consensus_queue.cc:260] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.159205 13385 ts_tablet_manager.cc:1428] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:23.197304 13366 raft_consensus.cc:482] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:23.197427 13366 raft_consensus.cc:504] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.197775 13366 leader_election.cc:288] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:23.198205 12915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db20b454c9d4736a17d4175113e3ba6" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353" is_pre_election: true
I20260807 18:43:23.198205 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db20b454c9d4736a17d4175113e3ba6" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af55444a9921491c8f92c32835bc24e2" is_pre_election: true
I20260807 18:43:23.198364 13204 raft_consensus.cc:2454] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 0.
I20260807 18:43:23.198364 12915 raft_consensus.cc:2454] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 0.
I20260807 18:43:23.198699 12992 leader_election.cc:302] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, f02c53606e9442268db2d75758c14bcf; no voters:
I20260807 18:43:23.198904 13366 raft_consensus.cc:2781] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:23.198968 13366 raft_consensus.cc:482] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:23.199018 13366 raft_consensus.cc:3037] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:23.200174 13366 raft_consensus.cc:504] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.200562 13366 leader_election.cc:288] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 election: Requested vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569)
I20260807 18:43:23.200846 12915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db20b454c9d4736a17d4175113e3ba6" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353"
I20260807 18:43:23.200920 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db20b454c9d4736a17d4175113e3ba6" candidate_uuid: "f02c53606e9442268db2d75758c14bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af55444a9921491c8f92c32835bc24e2"
I20260807 18:43:23.200986 12915 raft_consensus.cc:3037] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:23.201066 13204 raft_consensus.cc:3037] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:23.201898 12915 raft_consensus.cc:2454] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 1.
I20260807 18:43:23.202019 13204 raft_consensus.cc:2454] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02c53606e9442268db2d75758c14bcf in term 1.
I20260807 18:43:23.202152 12992 leader_election.cc:302] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, f02c53606e9442268db2d75758c14bcf; no voters:
I20260807 18:43:23.202350 13366 raft_consensus.cc:2781] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:23.202455 13366 raft_consensus.cc:686] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 1 LEADER]: Becoming Leader. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Running, Role: LEADER
I20260807 18:43:23.202596 13366 consensus_queue.cc:237] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.204277 12751 catalog_manager.cc:5495] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to f02c53606e9442268db2d75758c14bcf (127.10.174.194). New cstate: current_term: 1 leader_uuid: "f02c53606e9442268db2d75758c14bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:23.225332 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:23.221757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56950 (local address 127.10.174.194:45405)
0807 18:43:23.222016 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:23.222096 (+ 80us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:23.222110 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:23.222154 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:23.222156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:23.222195 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:23.222290 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:23.222558 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.223099 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.224086 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.224436 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.224531 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:23.224833 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:23.224963 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:23.225048 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:23.225135 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 18:43:23.225185 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":107,"threads_started":1}
I20260807 18:43:23.231120 13204 raft_consensus.cc:1261] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Refusing update from remote peer f02c53606e9442268db2d75758c14bcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:23.231120 12915 raft_consensus.cc:1261] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Refusing update from remote peer f02c53606e9442268db2d75758c14bcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:23.231513 13366 consensus_queue.cc:1035] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:23.231679 13362 consensus_queue.cc:1035] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:23.235255 13349 mvcc.cc:205] Tried to move back new op lower bound from 7315981120431337472 to 7315981120319234048. Current Snapshot: MvccSnapshot[applied={T|T < 7315981120431337472}]
I20260807 18:43:23.261329 12750 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:23.261466 12750 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:23.263229 12750 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Sending DeleteTablet for 3 replicas of tablet 7db20b454c9d4736a17d4175113e3ba6
I20260807 18:43:23.263840 13039 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db20b454c9d4736a17d4175113e3ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:23 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:56918
I20260807 18:43:23.263826 12895 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db20b454c9d4736a17d4175113e3ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:23 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:43890
I20260807 18:43:23.263926 13183 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db20b454c9d4736a17d4175113e3ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:23 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:34416
I20260807 18:43:23.264004 13371 tablet_replica.cc:330] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: stopping tablet replica
I20260807 18:43:23.264125 13372 tablet_replica.cc:330] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: stopping tablet replica
I20260807 18:43:23.264129 13371 raft_consensus.cc:2229] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:23.264254 13371 raft_consensus.cc:2258] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:23.264266 13372 raft_consensus.cc:2229] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:23.264459 13372 raft_consensus.cc:2258] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:23.264647 13373 tablet_replica.cc:330] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: stopping tablet replica
I20260807 18:43:23.264778 13373 raft_consensus.cc:2229] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:23.264887 13373 raft_consensus.cc:2258] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:23.265161 13372 ts_tablet_manager.cc:1905] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:23.265233 12750 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35034:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:43:23.265498 13373 ts_tablet_manager.cc:1905] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 18:43:23.265640 12750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:23.267877 13372 ts_tablet_manager.cc:1918] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:23.267964 13372 log.cc:1196] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/7db20b454c9d4736a17d4175113e3ba6
I20260807 18:43:23.268128 13373 ts_tablet_manager.cc:1918] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:23.268220 13373 log.cc:1196] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/7db20b454c9d4736a17d4175113e3ba6
I20260807 18:43:23.268230 13372 ts_tablet_manager.cc:1939] T 7db20b454c9d4736a17d4175113e3ba6 P f02c53606e9442268db2d75758c14bcf: Deleting consensus metadata
I20260807 18:43:23.268464 13373 ts_tablet_manager.cc:1939] T 7db20b454c9d4736a17d4175113e3ba6 P af55444a9921491c8f92c32835bc24e2: Deleting consensus metadata
I20260807 18:43:23.269371 13371 ts_tablet_manager.cc:1905] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:23.269397 12736 catalog_manager.cc:4841] TS af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569): tablet 7db20b454c9d4736a17d4175113e3ba6 (table test-table [id=58daacccf4454231a302e16057148470]) successfully deleted
I20260807 18:43:23.269543 12736 catalog_manager.cc:4841] TS f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405): tablet 7db20b454c9d4736a17d4175113e3ba6 (table test-table [id=58daacccf4454231a302e16057148470]) successfully deleted
I20260807 18:43:23.270171 12895 tablet_service.cc:1467] Processing CreateTablet for tablet bb9253aa7ad541ed83cd03248e4b4f89 (DEFAULT_TABLE table=test-table [id=6ad15b5ce467497b9493541c351e07d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:23.270211 13039 tablet_service.cc:1467] Processing CreateTablet for tablet bb9253aa7ad541ed83cd03248e4b4f89 (DEFAULT_TABLE table=test-table [id=6ad15b5ce467497b9493541c351e07d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:23.270431 12895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb9253aa7ad541ed83cd03248e4b4f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:23.270470 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb9253aa7ad541ed83cd03248e4b4f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:23.271761 13371 ts_tablet_manager.cc:1918] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:23.271844 13371 log.cc:1196] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/7db20b454c9d4736a17d4175113e3ba6
I20260807 18:43:23.272083 13371 ts_tablet_manager.cc:1939] T 7db20b454c9d4736a17d4175113e3ba6 P 0788944aa7324679ad64aae86faa8353: Deleting consensus metadata
I20260807 18:43:23.272460 13382 tablet_bootstrap.cc:492] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Bootstrap starting.
I20260807 18:43:23.272827 13383 tablet_bootstrap.cc:492] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353: Bootstrap starting.
I20260807 18:43:23.272935 12738 catalog_manager.cc:4841] TS 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763): tablet 7db20b454c9d4736a17d4175113e3ba6 (table test-table [id=58daacccf4454231a302e16057148470]) successfully deleted
I20260807 18:43:23.273384 13382 tablet_bootstrap.cc:654] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:23.273329 13183 tablet_service.cc:1467] Processing CreateTablet for tablet bb9253aa7ad541ed83cd03248e4b4f89 (DEFAULT_TABLE table=test-table [id=6ad15b5ce467497b9493541c351e07d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:23.273597 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb9253aa7ad541ed83cd03248e4b4f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:23.273674 13383 tablet_bootstrap.cc:654] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:23.274423 13382 tablet_bootstrap.cc:492] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: No bootstrap required, opened a new log
I20260807 18:43:23.274525 13382 ts_tablet_manager.cc:1397] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 18:43:23.274875 13382 raft_consensus.cc:348] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.274995 13382 raft_consensus.cc:374] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:23.275036 13382 raft_consensus.cc:729] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02c53606e9442268db2d75758c14bcf, State: Initialized, Role: FOLLOWER
I20260807 18:43:23.275167 13382 consensus_queue.cc:260] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.275467 13382 ts_tablet_manager.cc:1428] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:23.275923 13385 tablet_bootstrap.cc:492] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Bootstrap starting.
I20260807 18:43:23.276722 13385 tablet_bootstrap.cc:654] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:23.277531 13383 tablet_bootstrap.cc:492] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353: No bootstrap required, opened a new log
I20260807 18:43:23.277638 13383 ts_tablet_manager.cc:1397] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 18:43:23.278015 13383 raft_consensus.cc:348] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.278143 13383 raft_consensus.cc:374] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:23.278187 13383 raft_consensus.cc:729] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0788944aa7324679ad64aae86faa8353, State: Initialized, Role: FOLLOWER
I20260807 18:43:23.278317 13383 consensus_queue.cc:260] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.278595 13383 ts_tablet_manager.cc:1428] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:23.279202 13385 tablet_bootstrap.cc:492] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: No bootstrap required, opened a new log
I20260807 18:43:23.279314 13385 ts_tablet_manager.cc:1397] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 18:43:23.279750 13385 raft_consensus.cc:348] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.279886 13385 raft_consensus.cc:374] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:23.279933 13385 raft_consensus.cc:729] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Initialized, Role: FOLLOWER
I20260807 18:43:23.280048 13385 consensus_queue.cc:260] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.280333 13385 ts_tablet_manager.cc:1428] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:23.455709 13348 raft_consensus.cc:482] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:23.455830 13348 raft_consensus.cc:504] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.456276 13348 leader_election.cc:288] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405)
I20260807 18:43:23.456722 13060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb9253aa7ad541ed83cd03248e4b4f89" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02c53606e9442268db2d75758c14bcf" is_pre_election: true
I20260807 18:43:23.456712 12915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb9253aa7ad541ed83cd03248e4b4f89" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353" is_pre_election: true
I20260807 18:43:23.456897 13060 raft_consensus.cc:2454] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 0.
I20260807 18:43:23.456903 12915 raft_consensus.cc:2454] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 0.
I20260807 18:43:23.457238 13137 leader_election.cc:302] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, af55444a9921491c8f92c32835bc24e2; no voters:
I20260807 18:43:23.457422 13348 raft_consensus.cc:2781] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:23.457482 13348 raft_consensus.cc:482] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:23.457520 13348 raft_consensus.cc:3037] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:23.458863 13348 raft_consensus.cc:504] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.459192 13348 leader_election.cc:288] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 election: Requested vote from peers 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763), f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405)
I20260807 18:43:23.459507 12915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb9253aa7ad541ed83cd03248e4b4f89" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0788944aa7324679ad64aae86faa8353"
I20260807 18:43:23.459563 13060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb9253aa7ad541ed83cd03248e4b4f89" candidate_uuid: "af55444a9921491c8f92c32835bc24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02c53606e9442268db2d75758c14bcf"
I20260807 18:43:23.459645 12915 raft_consensus.cc:3037] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:23.459671 13060 raft_consensus.cc:3037] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:23.460557 12915 raft_consensus.cc:2454] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 1.
I20260807 18:43:23.460558 13060 raft_consensus.cc:2454] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af55444a9921491c8f92c32835bc24e2 in term 1.
I20260807 18:43:23.460835 13137 leader_election.cc:302] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0788944aa7324679ad64aae86faa8353, af55444a9921491c8f92c32835bc24e2; no voters:
I20260807 18:43:23.461038 13348 raft_consensus.cc:2781] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:23.461133 13348 raft_consensus.cc:686] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 1 LEADER]: Becoming Leader. State: Replica: af55444a9921491c8f92c32835bc24e2, State: Running, Role: LEADER
I20260807 18:43:23.461280 13348 consensus_queue.cc:237] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } }
I20260807 18:43:23.462849 12750 catalog_manager.cc:5495] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to af55444a9921491c8f92c32835bc24e2 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "af55444a9921491c8f92c32835bc24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af55444a9921491c8f92c32835bc24e2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39569 } health_report { overall_health: HEALTHY } } }
I20260807 18:43:23.513805 13401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:23.510770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34436 (local address 127.10.174.195:39569)
0807 18:43:23.511051 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:23.511059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:23.511070 (+ 11us) server_negotiation.cc:407] Connection header received
0807 18:43:23.511120 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:23.511122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:23.511163 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:23.511237 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:23.511537 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.512072 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.512850 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.513069 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.513155 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:23.513347 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:23.513411 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:23.513463 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:23.513558 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 18:43:23.513602 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":122,"threads_started":1}
I20260807 18:43:23.522280 13401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:23.519519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:53405 (local address 127.10.174.195:39569)
0807 18:43:23.519638 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:23.519641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:23.519721 (+ 80us) server_negotiation.cc:407] Connection header received
0807 18:43:23.519814 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:23.519816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:23.519856 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:23.519918 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:23.520167 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.520625 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.521413 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.521634 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.521708 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:23.521921 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:23.521980 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:23.522034 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:23.522115 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 18:43:23.522155 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":48}
I20260807 18:43:23.522301 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:23.519319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39569 (local address 127.10.174.195:53405)
0807 18:43:23.519631 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:23.519647 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:23.519739 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:23.519943 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:23.519945 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:23.519951 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:23.520081 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:23.520085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.520733 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.520735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:23.521315 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:23.521322 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:23.521733 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:23.521736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:23.521801 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:23.521825 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:23.522055 (+ 230us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:23.522060 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 18:43:23.522107 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 18:43:23.522182 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":15,"thread_start_us":172,"threads_started":1}
I20260807 18:43:23.528170 13060 raft_consensus.cc:1261] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Refusing update from remote peer af55444a9921491c8f92c32835bc24e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:23.528229 12915 raft_consensus.cc:1261] T bb9253aa7ad541ed83cd03248e4b4f89 P 0788944aa7324679ad64aae86faa8353 [term 1 FOLLOWER]: Refusing update from remote peer af55444a9921491c8f92c32835bc24e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:23.528667 13351 consensus_queue.cc:1035] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0788944aa7324679ad64aae86faa8353" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 35763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:23.528815 13348 consensus_queue.cc:1035] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f02c53606e9442268db2d75758c14bcf" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 18:43:23.542723 13349 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 18:43:25.095973 12750 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:25.096146 12750 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:25.098428 12750 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 411446fa6d454013b6e04bd386117eec: Sending DeleteTablet for 3 replicas of tablet bb9253aa7ad541ed83cd03248e4b4f89
I20260807 18:43:25.098991 13039 tablet_service.cc:1514] Processing DeleteTablet for tablet bb9253aa7ad541ed83cd03248e4b4f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:25 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:56918
I20260807 18:43:25.098987 12895 tablet_service.cc:1514] Processing DeleteTablet for tablet bb9253aa7ad541ed83cd03248e4b4f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:25 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:43890
I20260807 18:43:25.099108 13181 tablet_service.cc:1514] Processing DeleteTablet for tablet bb9253aa7ad541ed83cd03248e4b4f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:25 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:34416
I20260807 18:43:25.099407 13427 tablet_replica.cc:330] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: stopping tablet replica
I20260807 18:43:25.099483 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12827
I20260807 18:43:25.100989 13427 raft_consensus.cc:2229] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:25.101146 13427 raft_consensus.cc:2258] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:25.101222 13429 tablet_replica.cc:330] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: stopping tablet replica
I20260807 18:43:25.101347 13429 raft_consensus.cc:2229] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:25.101668 13429 raft_consensus.cc:2258] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:25.101819 13427 ts_tablet_manager.cc:1905] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:25.103717 13429 ts_tablet_manager.cc:1905] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:25.105366 13427 ts_tablet_manager.cc:1918] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 18:43:25.105453 13427 log.cc:1196] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/bb9253aa7ad541ed83cd03248e4b4f89
I20260807 18:43:25.105743 13427 ts_tablet_manager.cc:1939] T bb9253aa7ad541ed83cd03248e4b4f89 P f02c53606e9442268db2d75758c14bcf: Deleting consensus metadata
I20260807 18:43:25.105904 13429 ts_tablet_manager.cc:1918] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 18:43:25.105993 13429 log.cc:1196] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/bb9253aa7ad541ed83cd03248e4b4f89
I20260807 18:43:25.106262 13429 ts_tablet_manager.cc:1939] T bb9253aa7ad541ed83cd03248e4b4f89 P af55444a9921491c8f92c32835bc24e2: Deleting consensus metadata
I20260807 18:43:25.106578 12736 catalog_manager.cc:4841] TS f02c53606e9442268db2d75758c14bcf (127.10.174.194:45405): tablet bb9253aa7ad541ed83cd03248e4b4f89 (table test-table [id=6ad15b5ce467497b9493541c351e07d5]) successfully deleted
I20260807 18:43:25.106967 12736 catalog_manager.cc:4841] TS af55444a9921491c8f92c32835bc24e2 (127.10.174.195:39569): tablet bb9253aa7ad541ed83cd03248e4b4f89 (table test-table [id=6ad15b5ce467497b9493541c351e07d5]) successfully deleted
W20260807 18:43:25.109486 12738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:35763 (error 108)
I20260807 18:43:25.109731 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12973
I20260807 18:43:25.115332 13431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:25.114774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:35763 (local address 127.0.0.1:43904)
0807 18:43:25.115072 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:25.115170 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:35763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":87,"threads_started":1}
W20260807 18:43:25.115599 12738 catalog_manager.cc:4584] TS 0788944aa7324679ad64aae86faa8353 (127.10.174.193:35763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bb9253aa7ad541ed83cd03248e4b4f89: Network error: Client connection negotiation failed: client connection to 127.10.174.193:35763: connect: Connection refused (error 111)
I20260807 18:43:25.118242 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 13118
I20260807 18:43:25.126500 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 12717
2026-08-07T18:43:25Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6579 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:25 dist-test-slave-07c2 krb5kdc[13434](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:25 dist-test-slave-07c2 krb5kdc[13434](info): set up 2 sockets
Aug 07 18:43:25 dist-test-slave-07c2 krb5kdc[13434](info): commencing operation
krb5kdc: starting...
W20260807 18:43:26.195948 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:26.316169 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:41927
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:41927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:26.422021 13447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:26.422253 13447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:26.422292 13447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:26.426084 13447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:26.426129 13447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:26.426148 13447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:26.426164 13447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:26.426179 13447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:26.431362 13447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:41927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:41927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:26.432206 13447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:26.433077 13447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:26.441370 13452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:26.441429 13447 server_base.cc:1034] running on GCE node
W20260807 18:43:26.441447 13455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:26.441429 13453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:26.442178 13447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:26.443151 13447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:26.444315 13447 hybrid_clock.cc:648] HybridClock initialized: now 1786128206444299 us; error 31 us; skew 500 ppm
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:26.452473 13447 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:26.453442 13447 webserver.cc:460] Webserver started at http://127.10.174.254:42565/ using document root <none> and password file <none>
I20260807 18:43:26.453986 13447 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:26.454078 13447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:26.454319 13447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:26.456398 13447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "ff781088a1e740f5b7ff271cf9e87e75"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "7ee3b2f9954136a16b8deae2bcfd5ccf"
server_key_iv: "00db3461f42c964bb7934554f518458a"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.456974 13447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "ff781088a1e740f5b7ff271cf9e87e75"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "7ee3b2f9954136a16b8deae2bcfd5ccf"
server_key_iv: "00db3461f42c964bb7934554f518458a"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.460500 13447 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:43:26.462904 13462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.464059 13447 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:26.464203 13447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "ff781088a1e740f5b7ff271cf9e87e75"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "7ee3b2f9954136a16b8deae2bcfd5ccf"
server_key_iv: "00db3461f42c964bb7934554f518458a"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.464313 13447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:26.484521 13447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:26.487260 13447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:26.487556 13447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:26.494350 13447 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:41927
I20260807 18:43:26.494379 13516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:41927 every 8 connection(s)
I20260807 18:43:26.495263 13447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:26.497865 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:26.501869 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 13447
I20260807 18:43:26.501991 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:26.502261 10939 external_mini_cluster.cc:1428] Setting key 54c998d3bf6b1c8b41a7c0c896d776e5
I20260807 18:43:26.503587 13517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75: Bootstrap starting.
I20260807 18:43:26.505748 13517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:26.506592 13517 log.cc:824] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:26.508677 13517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75: No bootstrap required, opened a new log
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:26.513224 13517 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff781088a1e740f5b7ff271cf9e87e75" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41927 } }
I20260807 18:43:26.513477 13517 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:26.513558 13517 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff781088a1e740f5b7ff271cf9e87e75, State: Initialized, Role: FOLLOWER
I20260807 18:43:26.513958 13517 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff781088a1e740f5b7ff271cf9e87e75" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41927 } }
I20260807 18:43:26.514102 13517 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:26.514190 13517 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:26.514293 13517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:26.515349 13517 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff781088a1e740f5b7ff271cf9e87e75" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41927 } }
I20260807 18:43:26.515718 13517 leader_election.cc:302] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff781088a1e740f5b7ff271cf9e87e75; no voters:
I20260807 18:43:26.516072 13517 leader_election.cc:288] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:26.516263 13522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:26.516553 13522 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [term 1 LEADER]: Becoming Leader. State: Replica: ff781088a1e740f5b7ff271cf9e87e75, State: Running, Role: LEADER
I20260807 18:43:26.516846 13522 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff781088a1e740f5b7ff271cf9e87e75" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41927 } }
I20260807 18:43:26.517263 13517 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:26.517361 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:26.503781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50216 (local address 127.10.174.254:41927)
0807 18:43:26.504159 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:26.504178 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:26.504220 (+ 42us) server_negotiation.cc:407] Connection header received
0807 18:43:26.504840 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:26.504854 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:26.505150 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:26.505407 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:26.506362 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.507418 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.508553 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.509229 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.509790 (+ 561us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:26.512243 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:26.512249 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:26.512271 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:26.512296 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:26.514070 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:26.514580 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:26.514585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:26.514588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:26.514756 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:26.515046 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:26.515048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:26.515049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:26.515493 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:26.515682 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:26.515989 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 18:43:26.516451 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":121,"threads_started":1}
I20260807 18:43:26.517989 13522 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff781088a1e740f5b7ff271cf9e87e75. Latest consensus state: current_term: 1 leader_uuid: "ff781088a1e740f5b7ff271cf9e87e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff781088a1e740f5b7ff271cf9e87e75" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41927 } } }
I20260807 18:43:26.518095 13522 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:26.518419 13523 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff781088a1e740f5b7ff271cf9e87e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff781088a1e740f5b7ff271cf9e87e75" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41927 } } }
I20260807 18:43:26.518510 13523 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:26.519474 13530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:26.522414 13530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:26.527590 13530 catalog_manager.cc:1347] Generated new cluster ID: d4b2d7354503418eb24ba80771913f1b
I20260807 18:43:26.527649 13530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:26.533308 13530 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:26.534648 13530 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:26.549060 13530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff781088a1e740f5b7ff271cf9e87e75: Generated new TSK 0
I20260807 18:43:26.549774 13530 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:26.586690 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41927
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:26.698089 13546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:26.698354 13546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:26.698398 13546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:26.702411 13546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:26.702471 13546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:26.702529 13546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:26.707829 13546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:26.708878 13546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:26.709826 13546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:26.719343 13551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:26.719341 13553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:26.719450 13546 server_base.cc:1034] running on GCE node
W20260807 18:43:26.719343 13555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:26.720098 13546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:26.720741 13546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:26.721925 13546 hybrid_clock.cc:648] HybridClock initialized: now 1786128206721913 us; error 26 us; skew 500 ppm
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:26.724711 13546 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:26.725555 13546 webserver.cc:460] Webserver started at http://127.10.174.193:39565/ using document root <none> and password file <none>
I20260807 18:43:26.726054 13546 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:26.726110 13546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:26.726275 13546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:26.728367 13546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "d0255a65692c429bb7028c03f5bf1751"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "54081e7d2230c725073b6c3c1cc8f203"
server_key_iv: "ce1181ea9f0caff9d5fc307d2c98394b"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.728955 13546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "d0255a65692c429bb7028c03f5bf1751"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "54081e7d2230c725073b6c3c1cc8f203"
server_key_iv: "ce1181ea9f0caff9d5fc307d2c98394b"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.732722 13546 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:43:26.734941 13562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.736107 13546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:26.736228 13546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "d0255a65692c429bb7028c03f5bf1751"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "54081e7d2230c725073b6c3c1cc8f203"
server_key_iv: "ce1181ea9f0caff9d5fc307d2c98394b"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.736330 13546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:26.754843 13546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:26.757769 13546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:26.757975 13546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:26.758574 13546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:26.759424 13546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:26.759470 13546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.759536 13546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:26.759567 13546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.768990 13546 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:35557
I20260807 18:43:26.769016 13681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:35557 every 8 connection(s)
I20260807 18:43:26.769850 13546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:26.773195 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 13546
I20260807 18:43:26.773310 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:26.773599 10939 external_mini_cluster.cc:1428] Setting key 7e223457081aed0f2d11461636e2d829
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:26.784039 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:26.771551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:50897 (local address 127.10.174.254:41927)
0807 18:43:26.771687 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:26.771690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:26.772701 (+ 1011us) server_negotiation.cc:407] Connection header received
0807 18:43:26.773801 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:26.773803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:26.773851 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:26.773927 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:26.775234 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.775791 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.777458 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.777694 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.777812 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:26.780497 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:26.780500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:26.780502 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:26.780525 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:26.781932 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:26.782513 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:26.782515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:26.782516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:26.782583 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:26.782975 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:26.782977 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:26.782978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:26.783130 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:26.783203 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:26.783825 (+ 622us) server_negotiation.cc:299] Negotiation successful
0807 18:43:26.783922 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:43:26.784837 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:26.771933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:41927 (local address 127.10.174.193:50897)
0807 18:43:26.772545 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:26.772583 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:26.773536 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:26.774113 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:26.774118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:26.774525 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:26.775062 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:26.775098 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.775918 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.775924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:26.777336 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:26.777345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.777845 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.777850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:26.778014 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:26.778554 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:26.778568 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:26.780336 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:26.782053 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:26.782058 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:26.782070 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:26.782420 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:26.782674 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:26.782679 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:26.782691 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:26.782878 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:26.783242 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:26.783248 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:26.783549 (+ 301us) client_negotiation.cc:769] Sending connection context
0807 18:43:26.783778 (+ 229us) client_negotiation.cc:240] Negotiation successful
0807 18:43:26.784060 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":102,"threads_started":1}
I20260807 18:43:26.785913 13683 heartbeater.cc:347] Connected to a master server at 127.10.174.254:41927
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:43:26.786154 13683 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:26.786629 13683 heartbeater.cc:511] Master 127.10.174.254:41927 requested a full tablet report, sending...
I20260807 18:43:26.788059 13480 ts_manager.cc:194] Registered new tserver with Master: d0255a65692c429bb7028c03f5bf1751 (127.10.174.193:35557)
I20260807 18:43:26.789140 13480 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:50897
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:26.800351 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41927
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:26.906831 13688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:26.907080 13688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:26.907159 13688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:26.911152 13688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:26.911217 13688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:26.911346 13688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:26.916567 13688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:26.917575 13688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:26.918628 13688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:26.927794 13696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:26.927800 13694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:26.927975 13688 server_base.cc:1034] running on GCE node
W20260807 18:43:26.927816 13693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:26.928519 13688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:26.929137 13688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:26.930330 13688 hybrid_clock.cc:648] HybridClock initialized: now 1786128206930323 us; error 31 us; skew 500 ppm
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:26.933146 13688 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:26.934010 13688 webserver.cc:460] Webserver started at http://127.10.174.194:39229/ using document root <none> and password file <none>
I20260807 18:43:26.934551 13688 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:26.934643 13688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:26.934891 13688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:26.936897 13688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "15dc72fba55f46ba87f9b51a9e90e827"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "3ebfea9aed8800f239a15e06e8017c6b"
server_key_iv: "aef7ed48599b0b2070cb5b3cafcb1442"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.937458 13688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "15dc72fba55f46ba87f9b51a9e90e827"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "3ebfea9aed8800f239a15e06e8017c6b"
server_key_iv: "aef7ed48599b0b2070cb5b3cafcb1442"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.941205 13688 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 18:43:26.943622 13703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.944751 13688 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:26.944882 13688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "15dc72fba55f46ba87f9b51a9e90e827"
format_stamp: "Formatted at 2026-08-07 18:43:26 on dist-test-slave-07c2"
server_key: "3ebfea9aed8800f239a15e06e8017c6b"
server_key_iv: "aef7ed48599b0b2070cb5b3cafcb1442"
server_key_version: "encryptionkey@0"
I20260807 18:43:26.944988 13688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:26.957561 13688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:26.960232 13688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:26.960426 13688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:26.960965 13688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:26.961793 13688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:26.961839 13688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.961905 13688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:26.961938 13688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:26.970418 13688 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:43449
I20260807 18:43:26.970491 13821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:43449 every 8 connection(s)
I20260807 18:43:26.971264 13688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:26.975770 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 13688
I20260807 18:43:26.975906 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:26.976181 10939 external_mini_cluster.cc:1428] Setting key 1495c0b0c7a22ad8138b742cc22b5641
Aug 07 18:43:26 dist-test-slave-07c2 krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128206, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:26.985335 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:26.972936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:49531 (local address 127.10.174.254:41927)
0807 18:43:26.973063 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:26.973067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:26.974045 (+ 978us) server_negotiation.cc:407] Connection header received
0807 18:43:26.974913 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:26.974916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:26.974975 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:26.975056 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:26.976286 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.976981 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.978619 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.978845 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.978936 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:26.981415 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:26.981422 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:26.981428 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:26.981461 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:26.983176 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:26.983707 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:26.983712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:26.983716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:26.983823 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:26.984167 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:26.984173 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:26.984178 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:26.984437 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:26.984554 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:26.985021 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 18:43:26.985143 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:26.985948 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:26.973288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:41927 (local address 127.10.174.194:49531)
0807 18:43:26.973904 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:26.973942 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:26.974714 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:26.975228 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:26.975234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:26.975612 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:26.976136 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:26.976150 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.977106 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.977110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:26.978456 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:26.978472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:26.979004 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:26.979010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:26.979244 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:26.979851 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:26.979867 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:26.981245 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:26.983338 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:26.983344 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:26.983354 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:26.983597 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:26.983929 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:26.983932 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:26.983933 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:26.984056 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:26.984546 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:26.984551 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:26.984769 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 18:43:26.984910 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 18:43:26.985136 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:26.987067 13822 heartbeater.cc:347] Connected to a master server at 127.10.174.254:41927
I20260807 18:43:26.987352 13822 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:26.987819 13822 heartbeater.cc:511] Master 127.10.174.254:41927 requested a full tablet report, sending...
I20260807 18:43:26.988823 13480 ts_manager.cc:194] Registered new tserver with Master: 15dc72fba55f46ba87f9b51a9e90e827 (127.10.174.194:43449)
I20260807 18:43:26.989346 13480 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:49531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:27.004429 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41927
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:27.113205 13827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:27.113468 13827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:27.113510 13827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:27.117688 13827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:27.117749 13827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:27.117808 13827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:27.123477 13827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:27.124630 13827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:27.125554 13827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:27.134971 13833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:27.134984 13834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:27.134984 13836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:27.135214 13827 server_base.cc:1034] running on GCE node
I20260807 18:43:27.135712 13827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:27.136267 13827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:27.137434 13827 hybrid_clock.cc:648] HybridClock initialized: now 1786128207137404 us; error 41 us; skew 500 ppm
Aug 07 18:43:27 dist-test-slave-07c2 krb5kdc[13434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128207, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:27.140379 13827 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:27.141255 13827 webserver.cc:460] Webserver started at http://127.10.174.195:36119/ using document root <none> and password file <none>
I20260807 18:43:27.141747 13827 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:27.141803 13827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:27.141957 13827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:27.144001 13827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "a1e5264c28624f05866718b0465b6aa6"
format_stamp: "Formatted at 2026-08-07 18:43:27 on dist-test-slave-07c2"
server_key: "db6c43e2cb42b28423de43d0e3792b81"
server_key_iv: "e7154997166f7100d375ea1012c50abb"
server_key_version: "encryptionkey@0"
I20260807 18:43:27.144549 13827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "a1e5264c28624f05866718b0465b6aa6"
format_stamp: "Formatted at 2026-08-07 18:43:27 on dist-test-slave-07c2"
server_key: "db6c43e2cb42b28423de43d0e3792b81"
server_key_iv: "e7154997166f7100d375ea1012c50abb"
server_key_version: "encryptionkey@0"
I20260807 18:43:27.148175 13827 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:43:27.150914 13843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:27.152138 13827 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:27.152278 13827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "a1e5264c28624f05866718b0465b6aa6"
format_stamp: "Formatted at 2026-08-07 18:43:27 on dist-test-slave-07c2"
server_key: "db6c43e2cb42b28423de43d0e3792b81"
server_key_iv: "e7154997166f7100d375ea1012c50abb"
server_key_version: "encryptionkey@0"
I20260807 18:43:27.152390 13827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:27.163849 13827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:27.166424 13827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:27.166612 13827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:27.167168 13827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:27.168011 13827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:27.168080 13827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:27.168147 13827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:27.168186 13827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:27.177110 13827 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:34445
I20260807 18:43:27.177134 13961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:34445 every 8 connection(s)
I20260807 18:43:27.177946 13827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:27.180675 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 13827
I20260807 18:43:27.180792 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:27.181078 10939 external_mini_cluster.cc:1428] Setting key f14669c8e16898ae09f469fac95301ab
Aug 07 18:43:27 dist-test-slave-07c2 krb5kdc[13434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128207, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:27.190938 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:27.179685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:46973 (local address 127.10.174.254:41927)
0807 18:43:27.179836 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:27.179841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:27.180864 (+ 1023us) server_negotiation.cc:407] Connection header received
0807 18:43:27.181945 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:27.181950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:27.182007 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:27.182089 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:27.183505 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:27.184017 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:27.185090 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:27.185299 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:27.185372 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:27.187796 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:27.187799 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:27.187801 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:27.187823 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:27.189311 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:27.189733 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:27.189736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:27.189737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:27.189811 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:27.190087 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:27.190089 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:27.190090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:27.190253 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:27.190331 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:27.190733 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 18:43:27.190822 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:27.191689 13964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:27.180079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:41927 (local address 127.10.174.195:46973)
0807 18:43:27.180696 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:27.180762 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:27.181723 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:27.182288 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:27.182297 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:27.182765 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:27.183381 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:27.183397 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:27.184121 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:27.184123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:27.184989 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:27.184997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:27.185420 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:27.185423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:27.185553 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:27.186171 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:27.186187 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:27.187654 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:27.189406 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:27.189410 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:27.189419 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:27.189647 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:27.189891 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:27.189893 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:27.189894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:27.190011 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:27.190341 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:27.190345 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:27.190540 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 18:43:27.190682 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 18:43:27.190903 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":105,"threads_started":1}
I20260807 18:43:27.192799 13962 heartbeater.cc:347] Connected to a master server at 127.10.174.254:41927
I20260807 18:43:27.192986 13962 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:27.193382 13962 heartbeater.cc:511] Master 127.10.174.254:41927 requested a full tablet report, sending...
I20260807 18:43:27.194573 13480 ts_manager.cc:194] Registered new tserver with Master: a1e5264c28624f05866718b0465b6aa6 (127.10.174.195:34445)
I20260807 18:43:27.195081 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:43:27.195145 13480 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:46973
W20260807 18:43:27.208256 13520 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:27.206982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50218 (local address 127.10.174.254:41927)
0807 18:43:27.207117 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:27.207120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:27.207351 (+ 231us) server_negotiation.cc:407] Connection header received
0807 18:43:27.207441 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:27.207444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:27.207482 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:27.207554 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:27.208155 (+ 601us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50218: BlockingRecv error: recv got EOF from 127.0.0.1:50218 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:27.209236 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 13546
I20260807 18:43:27.216841 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 13688
I20260807 18:43:27.222959 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 13827
I20260807 18:43:27.228425 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 13447
2026-08-07T18:43:27Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2099 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:27 dist-test-slave-07c2 krb5kdc[13975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:27 dist-test-slave-07c2 krb5kdc[13975](info): set up 2 sockets
Aug 07 18:43:27 dist-test-slave-07c2 krb5kdc[13975](info): commencing operation
krb5kdc: starting...
W20260807 18:43:28.285889 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:28 dist-test-slave-07c2 krb5kdc[13975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:28.404322 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38945
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:36209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:28.511009 13988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:28.511240 13988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:28.511336 13988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:28.515251 13988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:28.515321 13988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:28.515341 13988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:28.515357 13988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:28.515395 13988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:28.522074 13988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:36209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:28.523161 13988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:28.524192 13988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:28.532451 13993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:28.532524 13988 server_base.cc:1034] running on GCE node
W20260807 18:43:28.532580 13996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:28.532452 13994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:28.533260 13988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:28.534298 13988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:28.535486 13988 hybrid_clock.cc:648] HybridClock initialized: now 1786128208535461 us; error 38 us; skew 500 ppm
Aug 07 18:43:28 dist-test-slave-07c2 krb5kdc[13975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128208, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:28.538242 13988 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:28.539114 13988 webserver.cc:460] Webserver started at http://127.10.174.254:44241/ using document root <none> and password file <none>
I20260807 18:43:28.539707 13988 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:28.539768 13988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:28.539928 13988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:28.541880 13988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "199bf47dfadb4cffa7039dc668b1514c"
format_stamp: "Formatted at 2026-08-07 18:43:28 on dist-test-slave-07c2"
server_key: "f6ad27c1c7137aa0cce9e076229720ae"
server_key_iv: "f22072770fe144275de2e7733c6f6c5b"
server_key_version: "encryptionkey@0"
I20260807 18:43:28.542402 13988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "199bf47dfadb4cffa7039dc668b1514c"
format_stamp: "Formatted at 2026-08-07 18:43:28 on dist-test-slave-07c2"
server_key: "f6ad27c1c7137aa0cce9e076229720ae"
server_key_iv: "f22072770fe144275de2e7733c6f6c5b"
server_key_version: "encryptionkey@0"
I20260807 18:43:28.546000 13988 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 18:43:28.548446 14003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:28.549652 13988 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:28.549799 13988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "199bf47dfadb4cffa7039dc668b1514c"
format_stamp: "Formatted at 2026-08-07 18:43:28 on dist-test-slave-07c2"
server_key: "f6ad27c1c7137aa0cce9e076229720ae"
server_key_iv: "f22072770fe144275de2e7733c6f6c5b"
server_key_version: "encryptionkey@0"
I20260807 18:43:28.549911 13988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:28.565178 13988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:28.568545 13988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:28.568710 13988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:28.575893 13988 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38945
I20260807 18:43:28.576177 14058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38945 every 8 connection(s)
I20260807 18:43:28.576859 13988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:28.579567 14059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:28.580410 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 13988
I20260807 18:43:28.580504 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:28.580811 10939 external_mini_cluster.cc:1428] Setting key dc870debed39508ae6c3ca5c08bd0a84
I20260807 18:43:28.586031 14059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c: Bootstrap starting.
I20260807 18:43:28.588471 14059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:28.589197 14059 log.cc:824] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:43:28 dist-test-slave-07c2 krb5kdc[13975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:28.591266 14059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c: No bootstrap required, opened a new log
I20260807 18:43:28.595672 14063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:28.582190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48514 (local address 127.10.174.254:38945)
0807 18:43:28.582629 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:28.582649 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:28.582694 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:43:28.583518 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:28.583541 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:28.583934 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:28.584299 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:28.584929 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:28.586340 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:28.587179 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:28.587873 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:28.588030 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:28.590631 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:28.590637 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:28.590651 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:28.590683 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:28.592619 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:28.593021 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:28.593027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:28.593033 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:28.593176 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:28.593441 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:28.593444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:28.593446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:28.594046 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:28.594243 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:28.594445 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 18:43:28.594729 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":111,"threads_started":1}
I20260807 18:43:28.595974 14059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "199bf47dfadb4cffa7039dc668b1514c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38945 } }
I20260807 18:43:28.596184 14059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:28.596252 14059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 199bf47dfadb4cffa7039dc668b1514c, State: Initialized, Role: FOLLOWER
I20260807 18:43:28.596626 14059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "199bf47dfadb4cffa7039dc668b1514c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38945 } }
I20260807 18:43:28.596781 14059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:28.596864 14059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:28.597012 14059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:28.597991 14059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "199bf47dfadb4cffa7039dc668b1514c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38945 } }
I20260807 18:43:28.598306 14059 leader_election.cc:302] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 199bf47dfadb4cffa7039dc668b1514c; no voters:
I20260807 18:43:28.598507 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:43:28.598621 14059 leader_election.cc:288] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:28.598711 14065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:28.598948 14065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [term 1 LEADER]: Becoming Leader. State: Replica: 199bf47dfadb4cffa7039dc668b1514c, State: Running, Role: LEADER
I20260807 18:43:28.599259 14065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "199bf47dfadb4cffa7039dc668b1514c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38945 } }
I20260807 18:43:28.599809 14059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:28.600431 14065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 199bf47dfadb4cffa7039dc668b1514c. Latest consensus state: current_term: 1 leader_uuid: "199bf47dfadb4cffa7039dc668b1514c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "199bf47dfadb4cffa7039dc668b1514c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38945 } } }
I20260807 18:43:28.600554 14065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:28.600871 14066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "199bf47dfadb4cffa7039dc668b1514c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "199bf47dfadb4cffa7039dc668b1514c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38945 } } }
I20260807 18:43:28.600960 14066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c [sys.catalog]: This master's current role is: LEADER
W20260807 18:43:28.604668 14082 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:28.604746 14082 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:28.604872 14072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:28.605551 14072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:28.610754 14072 catalog_manager.cc:1347] Generated new cluster ID: 3ed3791d96ff480c829c1aa70dcd6627
I20260807 18:43:28.610819 14072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:28.621467 14063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:28.616031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.10.174.254:38945)
0807 18:43:28.616127 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:28.616132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:28.616384 (+ 252us) server_negotiation.cc:407] Connection header received
0807 18:43:28.616481 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:28.616484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:28.616537 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:28.616647 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:28.617196 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:28.617976 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:28.619097 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:28.619501 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:28.619605 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:28.620510 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:28.620515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:28.620518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:28.621019 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:28.621052 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:28.621071 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:28.621160 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:28.621273 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 18:43:28.621333 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 18:43:28.625733 14072 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:28.626858 14072 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:28.638826 14072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 199bf47dfadb4cffa7039dc668b1514c: Generated new TSK 0
I20260807 18:43:28.639612 14072 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:43:28.652436 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 13988
2026-08-07T18:43:28Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1423 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:28 dist-test-slave-07c2 krb5kdc[14094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:28 dist-test-slave-07c2 krb5kdc[14094](info): set up 2 sockets
Aug 07 18:43:28 dist-test-slave-07c2 krb5kdc[14094](info): commencing operation
krb5kdc: starting...
W20260807 18:43:29.705235 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:29 dist-test-slave-07c2 krb5kdc[14094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:29.828590 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43473
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43473
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:29.935982 14107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:29.936272 14107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:29.936378 14107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:29.940495 14107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:29.940572 14107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:29.940609 14107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:29.940670 14107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:29.940711 14107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:29.945734 14107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43473
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:29.946689 14107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:29.947713 14107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:29.955785 14115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:29.955785 14113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:29.955825 14112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:29.956110 14107 server_base.cc:1034] running on GCE node
I20260807 18:43:29.956604 14107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:29.957551 14107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:29.958707 14107 hybrid_clock.cc:648] HybridClock initialized: now 1786128209958691 us; error 30 us; skew 500 ppm
Aug 07 18:43:29 dist-test-slave-07c2 krb5kdc[14094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128209, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:29.961314 14107 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:29.962203 14107 webserver.cc:460] Webserver started at http://127.10.174.254:34749/ using document root <none> and password file <none>
I20260807 18:43:29.962733 14107 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:29.962831 14107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:29.963058 14107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:29.965049 14107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "1b786d0ed237473c825601e3d11ad46f"
format_stamp: "Formatted at 2026-08-07 18:43:29 on dist-test-slave-07c2"
server_key: "06b325c7a1c97ea58ba7ba5adba46e17"
server_key_iv: "99bebce14b6e601fc29572febbc21cdd"
server_key_version: "encryptionkey@0"
I20260807 18:43:29.965600 14107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "1b786d0ed237473c825601e3d11ad46f"
format_stamp: "Formatted at 2026-08-07 18:43:29 on dist-test-slave-07c2"
server_key: "06b325c7a1c97ea58ba7ba5adba46e17"
server_key_iv: "99bebce14b6e601fc29572febbc21cdd"
server_key_version: "encryptionkey@0"
I20260807 18:43:29.969067 14107 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:29.971256 14123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:29.972424 14107 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:43:29.972558 14107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "1b786d0ed237473c825601e3d11ad46f"
format_stamp: "Formatted at 2026-08-07 18:43:29 on dist-test-slave-07c2"
server_key: "06b325c7a1c97ea58ba7ba5adba46e17"
server_key_iv: "99bebce14b6e601fc29572febbc21cdd"
server_key_version: "encryptionkey@0"
I20260807 18:43:29.972663 14107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:30.010767 14107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:30.013607 14107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:30.013833 14107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:30.020620 14107 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:43473
I20260807 18:43:30.020917 14177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:43473 every 8 connection(s)
I20260807 18:43:30.021540 14107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:30.024144 14178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:30.025058 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14107
I20260807 18:43:30.025189 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:30.025532 10939 external_mini_cluster.cc:1428] Setting key 2c990fed8be3548fa18d9070f18e443d
I20260807 18:43:30.030555 14178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f: Bootstrap starting.
I20260807 18:43:30.033181 14178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:30.034044 14178 log.cc:824] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:30.036048 14178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f: No bootstrap required, opened a new log
I20260807 18:43:30.039260 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.026929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60384 (local address 127.10.174.254:43473)
0807 18:43:30.027360 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:30.027378 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:30.027423 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:43:30.028025 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:30.028039 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:30.028341 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:30.028611 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:30.029496 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.030418 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.031560 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.032001 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.032117 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.034895 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:30.034899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:30.034910 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:30.034936 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:30.036590 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.037026 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.037030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.037034 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.037136 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.037421 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.037425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.037427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.037788 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:30.037978 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:30.038336 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 18:43:30.038606 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":133,"threads_started":1}
I20260807 18:43:30.039721 14178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b786d0ed237473c825601e3d11ad46f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43473 } }
I20260807 18:43:30.039942 14178 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:30.040019 14178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b786d0ed237473c825601e3d11ad46f, State: Initialized, Role: FOLLOWER
I20260807 18:43:30.040504 14178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b786d0ed237473c825601e3d11ad46f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43473 } }
I20260807 18:43:30.040658 14178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:30.040730 14178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:30.040829 14178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:30.041831 14178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b786d0ed237473c825601e3d11ad46f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43473 } }
I20260807 18:43:30.042105 14178 leader_election.cc:302] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b786d0ed237473c825601e3d11ad46f; no voters:
I20260807 18:43:30.042344 14178 leader_election.cc:288] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:30.042484 14183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:30.042737 14183 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [term 1 LEADER]: Becoming Leader. State: Replica: 1b786d0ed237473c825601e3d11ad46f, State: Running, Role: LEADER
I20260807 18:43:30.043046 14183 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b786d0ed237473c825601e3d11ad46f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43473 } }
I20260807 18:43:30.043535 14178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:30.044651 14185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b786d0ed237473c825601e3d11ad46f. Latest consensus state: current_term: 1 leader_uuid: "1b786d0ed237473c825601e3d11ad46f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b786d0ed237473c825601e3d11ad46f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43473 } } }
I20260807 18:43:30.044807 14185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:30.045421 14184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b786d0ed237473c825601e3d11ad46f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b786d0ed237473c825601e3d11ad46f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43473 } } }
I20260807 18:43:30.045567 14184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f [sys.catalog]: This master's current role is: LEADER
W20260807 18:43:30.048013 14199 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:30.048079 14199 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:30.048153 14192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:30.048807 14192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:30.053428 14192 catalog_manager.cc:1347] Generated new cluster ID: 903d373475b14d90807f14b9aacc6873
I20260807 18:43:30.053489 14192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:30.061360 14192 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:30.062420 14192 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:30.081221 14192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b786d0ed237473c825601e3d11ad46f: Generated new TSK 0
I20260807 18:43:30.081931 14192 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:30.115535 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43473
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:30.226289 14206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:30.226519 14206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:30.226560 14206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:30.230460 14206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:30.230518 14206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:30.230572 14206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:30.235575 14206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:30.236490 14206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:30.237388 14206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:30.246536 14215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:30.246541 14212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:30.246656 14211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:30.246774 14206 server_base.cc:1034] running on GCE node
I20260807 18:43:30.247224 14206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:30.247859 14206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:30.249053 14206 hybrid_clock.cc:648] HybridClock initialized: now 1786128210249042 us; error 31 us; skew 500 ppm
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:30.251860 14206 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:30.252674 14206 webserver.cc:460] Webserver started at http://127.10.174.193:36315/ using document root <none> and password file <none>
I20260807 18:43:30.253216 14206 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:30.253307 14206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:30.253551 14206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:30.255597 14206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "df13d89619964d6fb628666a5270f139"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "190b718c08a625a0412a88dd9c3e1383"
server_key_iv: "32cbf97b0d1a55df0a8b462994fc0cf7"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.256152 14206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "df13d89619964d6fb628666a5270f139"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "190b718c08a625a0412a88dd9c3e1383"
server_key_iv: "32cbf97b0d1a55df0a8b462994fc0cf7"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.259824 14206 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 18:43:30.262147 14223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.263371 14206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:30.263487 14206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "df13d89619964d6fb628666a5270f139"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "190b718c08a625a0412a88dd9c3e1383"
server_key_iv: "32cbf97b0d1a55df0a8b462994fc0cf7"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.263585 14206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:30.282038 14206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:30.285291 14206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:30.285496 14206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:30.286093 14206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:30.286917 14206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:30.286964 14206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.287035 14206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:30.287067 14206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.295688 14206 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:41717
I20260807 18:43:30.295715 14341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:41717 every 8 connection(s)
I20260807 18:43:30.296537 14206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:30.302359 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14206
I20260807 18:43:30.302485 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:30.302791 10939 external_mini_cluster.cc:1428] Setting key 33215ba6228c0f8a6b00a2f7b61439a9
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:30.310233 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.298265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:60657 (local address 127.10.174.254:43473)
0807 18:43:30.298400 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:30.298404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:30.299133 (+ 729us) server_negotiation.cc:407] Connection header received
0807 18:43:30.300559 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:30.300562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:30.300608 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:30.300680 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:30.301751 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.302562 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.303954 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.304282 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.304390 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.306734 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:30.306737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:30.306739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:30.306761 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:30.308238 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.308752 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.308757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.308759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.308839 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.309187 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.309192 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.309193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.309370 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:30.309475 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:30.309943 (+ 468us) server_negotiation.cc:299] Negotiation successful
0807 18:43:30.310063 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:43:30.310968 14344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.298585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43473 (local address 127.10.174.193:60657)
0807 18:43:30.298993 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:30.299033 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:30.300373 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:30.300850 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:30.300856 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:30.301183 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:30.301615 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:30.301627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.302692 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.302694 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:30.303846 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:30.303856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.304427 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.304429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:30.304565 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.305152 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:30.305171 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:30.306564 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:30.308361 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:30.308366 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:30.308380 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:30.308648 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:30.308941 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:30.308944 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:30.308946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:30.309084 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:30.309488 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:30.309496 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:30.309720 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 18:43:30.309898 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 18:43:30.310204 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:30.312263 14342 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43473
I20260807 18:43:30.312491 14342 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:30.312938 14342 heartbeater.cc:511] Master 127.10.174.254:43473 requested a full tablet report, sending...
I20260807 18:43:30.314302 14140 ts_manager.cc:194] Registered new tserver with Master: df13d89619964d6fb628666a5270f139 (127.10.174.193:41717)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:43:30.315478 14140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:60657
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:30.328250 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43473
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:30.433218 14348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:30.433431 14348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:30.433504 14348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:30.437410 14348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:30.437458 14348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:30.437558 14348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:30.442690 14348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:30.443678 14348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:30.444679 14348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:30.453578 14356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:30.453570 14354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:30.453572 14353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:30.453812 14348 server_base.cc:1034] running on GCE node
I20260807 18:43:30.454282 14348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:30.454849 14348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:30.456004 14348 hybrid_clock.cc:648] HybridClock initialized: now 1786128210455985 us; error 29 us; skew 500 ppm
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:30.458648 14348 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:30.459462 14348 webserver.cc:460] Webserver started at http://127.10.174.194:43821/ using document root <none> and password file <none>
I20260807 18:43:30.459975 14348 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:30.460062 14348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:30.460281 14348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:30.462143 14348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "ba611fce7bd748d1b0188cdb13d2519d"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "57bed75adc1e1f4215c758c555ca5963"
server_key_iv: "f0777e473a22fc0e395a1c4a30b42455"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.462687 14348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "ba611fce7bd748d1b0188cdb13d2519d"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "57bed75adc1e1f4215c758c555ca5963"
server_key_iv: "f0777e473a22fc0e395a1c4a30b42455"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.466185 14348 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 18:43:30.468461 14363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.469564 14348 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:30.469694 14348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "ba611fce7bd748d1b0188cdb13d2519d"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "57bed75adc1e1f4215c758c555ca5963"
server_key_iv: "f0777e473a22fc0e395a1c4a30b42455"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.469801 14348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:30.489924 14348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:30.492862 14348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:30.493070 14348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:30.493657 14348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:30.494472 14348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:30.494539 14348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.494611 14348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:30.494652 14348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.503492 14348 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:39439
I20260807 18:43:30.503518 14478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:39439 every 8 connection(s)
I20260807 18:43:30.504355 14348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:30.513800 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14348
I20260807 18:43:30.513944 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:30.514240 10939 external_mini_cluster.cc:1428] Setting key 7d94fd70f63435683fed72ef7fe07349
I20260807 18:43:30.517174 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.506076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:36241 (local address 127.10.174.254:43473)
0807 18:43:30.506234 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:30.506239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:30.507003 (+ 764us) server_negotiation.cc:407] Connection header received
0807 18:43:30.508237 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:30.508239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:30.508284 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:30.508355 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:30.509363 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.509869 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.510902 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.511107 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.511193 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.513439 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:30.513442 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:30.513444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:30.513466 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:30.515070 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.515698 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.515701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.515703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.515813 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.516168 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.516171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.516173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.516345 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:30.516445 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:30.516904 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 18:43:30.517010 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:43:30.518002 14481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.506444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43473 (local address 127.10.174.194:36241)
0807 18:43:30.506854 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:30.506894 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:30.508033 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:30.508473 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:30.508478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:30.508807 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:30.509232 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:30.509244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.509967 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.509970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:30.510806 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:30.510814 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.511231 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.511234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:30.511390 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.511854 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:30.511868 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:30.513284 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:30.515217 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:30.515221 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:30.515231 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:30.515595 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:30.515917 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:30.515921 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:30.515923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:30.516063 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:30.516444 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:30.516450 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:30.516665 (+ 215us) client_negotiation.cc:769] Sending connection context
0807 18:43:30.516834 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 18:43:30.517118 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":109,"threads_started":1}
I20260807 18:43:30.519140 14479 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43473
I20260807 18:43:30.519384 14479 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:30.519869 14479 heartbeater.cc:511] Master 127.10.174.254:43473 requested a full tablet report, sending...
I20260807 18:43:30.520864 14140 ts_manager.cc:194] Registered new tserver with Master: ba611fce7bd748d1b0188cdb13d2519d (127.10.174.194:39439)
I20260807 18:43:30.521411 14140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:36241
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:30.542104 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43473
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:30.651249 14484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:30.651564 14484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:30.651610 14484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:30.658906 14484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:30.658998 14484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:30.659153 14484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:30.668051 14484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:30.669407 14484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:30.670811 14484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:30.682713 14489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:30.682719 14491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:30.682768 14484 server_base.cc:1034] running on GCE node
W20260807 18:43:30.682861 14493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:30.683410 14484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:30.683991 14484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:30.685166 14484 hybrid_clock.cc:648] HybridClock initialized: now 1786128210685142 us; error 46 us; skew 500 ppm
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:30.687938 14484 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:30.689174 14484 webserver.cc:460] Webserver started at http://127.10.174.195:33321/ using document root <none> and password file <none>
I20260807 18:43:30.689970 14484 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:30.690073 14484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:30.690328 14484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:30.693204 14484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "deac6cc800e84f91a87d0995431b598b"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "47c434f7f577564af9d2fb00ef285ec6"
server_key_iv: "97270d854cb07f323af8d8717cbcece1"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.693791 14484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "deac6cc800e84f91a87d0995431b598b"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "47c434f7f577564af9d2fb00ef285ec6"
server_key_iv: "97270d854cb07f323af8d8717cbcece1"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.697468 14484 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:30.699905 14501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.701050 14484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:43:30.701169 14484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "deac6cc800e84f91a87d0995431b598b"
format_stamp: "Formatted at 2026-08-07 18:43:30 on dist-test-slave-07c2"
server_key: "47c434f7f577564af9d2fb00ef285ec6"
server_key_iv: "97270d854cb07f323af8d8717cbcece1"
server_key_version: "encryptionkey@0"
I20260807 18:43:30.701268 14484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:30.710608 14484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:30.713153 14484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:30.713330 14484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:30.713853 14484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:30.714587 14484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:30.714640 14484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.714732 14484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:30.714771 14484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:30.723383 14484 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:37595
I20260807 18:43:30.723446 14616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:37595 every 8 connection(s)
I20260807 18:43:30.724184 14484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:30.728758 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14484
I20260807 18:43:30.728892 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:30.729168 10939 external_mini_cluster.cc:1428] Setting key 6dee1edddf5d7c60d3f8d12ac50274ec
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:30.737025 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.725798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:45035 (local address 127.10.174.254:43473)
0807 18:43:30.725926 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:30.725930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:30.726555 (+ 625us) server_negotiation.cc:407] Connection header received
0807 18:43:30.727948 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:30.727951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:30.728009 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:30.728108 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:30.729265 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.729903 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.731378 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.731587 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.731693 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.733908 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:30.733911 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:30.733913 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:30.733932 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:30.735424 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.735849 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.735851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.735852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.735923 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.736196 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.736198 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.736199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.736353 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:30.736427 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:30.736820 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 18:43:30.736911 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:30.737792 14619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.726025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43473 (local address 127.10.174.195:45035)
0807 18:43:30.726414 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:30.726452 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:30.727740 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:30.728270 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:30.728276 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:30.728619 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:30.729127 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:30.729141 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.730101 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.730104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:30.731228 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:30.731239 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.731734 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.731737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:30.731871 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.732376 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:30.732391 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:30.733774 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:30.735515 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:30.735519 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:30.735529 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:30.735766 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:30.736000 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:30.736002 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:30.736003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:30.736120 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:30.736436 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:30.736440 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:30.736635 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 18:43:30.736784 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 18:43:30.737001 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":105,"threads_started":1}
I20260807 18:43:30.738857 14617 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43473
I20260807 18:43:30.739073 14617 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:30.739562 14617 heartbeater.cc:511] Master 127.10.174.254:43473 requested a full tablet report, sending...
I20260807 18:43:30.740536 14140 ts_manager.cc:194] Registered new tserver with Master: deac6cc800e84f91a87d0995431b598b (127.10.174.195:37595)
I20260807 18:43:30.741057 14140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:45035
I20260807 18:43:30.742945 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14094](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128210, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:30.768894 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:30.760505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60388 (local address 127.10.174.254:43473)
0807 18:43:30.760671 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:30.760676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:30.760828 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:43:30.761001 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:30.761004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:30.761044 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:30.761131 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:30.761899 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.762415 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.763323 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:30.763545 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:30.763655 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:30.765941 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:30.765944 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:30.765946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:30.765968 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:30.767458 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.767831 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.767833 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.767834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.767920 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:30.768177 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:30.768179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:30.768180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:30.768388 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:30.768486 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:30.768683 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 18:43:30.768776 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 18:43:30.769379 14140 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60388
I20260807 18:43:30.770622 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14206
I20260807 18:43:30.778053 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14348
I20260807 18:43:30.783993 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14484
I20260807 18:43:30.789834 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14107
2026-08-07T18:43:30Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2138 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14629](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14629](info): set up 2 sockets
Aug 07 18:43:30 dist-test-slave-07c2 krb5kdc[14629](info): commencing operation
krb5kdc: starting...
W20260807 18:43:31.841425 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:31 dist-test-slave-07c2 krb5kdc[14629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:31.961632 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38811
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:32.069443 14643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:32.069686 14643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:32.069761 14643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:32.073691 14643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:32.073738 14643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:32.073757 14643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:32.073799 14643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:32.073838 14643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:32.079016 14643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:32.079984 14643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:32.080938 14643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:32.088850 14651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.088860 14648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.088869 14649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:32.089239 14643 server_base.cc:1034] running on GCE node
I20260807 18:43:32.089707 14643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:32.090726 14643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:32.091918 14643 hybrid_clock.cc:648] HybridClock initialized: now 1786128212091895 us; error 39 us; skew 500 ppm
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:32.097596 14643 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:32.098429 14643 webserver.cc:460] Webserver started at http://127.10.174.254:38047/ using document root <none> and password file <none>
I20260807 18:43:32.098913 14643 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:32.098971 14643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:32.099123 14643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:32.101060 14643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "bcc1aacd8c98f08f1775135c63adfe55"
server_key_iv: "0cd23cee3e2c90e047181eb404271443"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.101557 14643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "bcc1aacd8c98f08f1775135c63adfe55"
server_key_iv: "0cd23cee3e2c90e047181eb404271443"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.105123 14643 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:32.107265 14659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.108470 14643 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:32.108582 14643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "bcc1aacd8c98f08f1775135c63adfe55"
server_key_iv: "0cd23cee3e2c90e047181eb404271443"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.108678 14643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:32.128157 14643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:32.130779 14643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:32.130923 14643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:32.137809 14643 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38811
I20260807 18:43:32.137828 14712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38811 every 8 connection(s)
I20260807 18:43:32.138706 14643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:32.141312 14713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:32.146646 14713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b: Bootstrap starting.
I20260807 18:43:32.147595 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14643
I20260807 18:43:32.147729 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:32.148042 10939 external_mini_cluster.cc:1428] Setting key 96eb80e7a6b2daa53d5f39764987d47f
I20260807 18:43:32.149617 14713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:32.150337 14713 log.cc:824] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:32.152500 14713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b: No bootstrap required, opened a new log
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:32.157106 14713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38811 } }
I20260807 18:43:32.157397 14713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:32.157478 14713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ea07c9cb8f4bc4b91bc515da1a5c6b, State: Initialized, Role: FOLLOWER
I20260807 18:43:32.157967 14713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38811 } }
I20260807 18:43:32.158142 14713 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:32.158214 14713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:32.158310 14713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:32.159578 14713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38811 } }
I20260807 18:43:32.159965 14713 leader_election.cc:302] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86ea07c9cb8f4bc4b91bc515da1a5c6b; no voters:
I20260807 18:43:32.160328 14713 leader_election.cc:288] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:32.160460 14718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:32.160717 14718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [term 1 LEADER]: Becoming Leader. State: Replica: 86ea07c9cb8f4bc4b91bc515da1a5c6b, State: Running, Role: LEADER
I20260807 18:43:32.161114 14718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38811 } }
I20260807 18:43:32.161607 14713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:32.162845 14719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38811 } } }
I20260807 18:43:32.163132 14719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:32.163344 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.149211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40426 (local address 127.10.174.254:38811)
0807 18:43:32.149604 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:32.149619 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:32.149655 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:43:32.150314 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:32.150330 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:32.150727 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:32.151092 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:32.151987 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.153008 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.154176 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.154643 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.154765 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.157787 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:32.157793 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:32.157809 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:32.157839 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:32.159966 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.160483 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.160491 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.160498 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.160655 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.161016 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.161020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.161022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.161525 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:32.161744 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:32.162032 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 18:43:32.162343 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":123,"threads_started":1}
I20260807 18:43:32.163640 14727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:32.164649 14720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86ea07c9cb8f4bc4b91bc515da1a5c6b. Latest consensus state: current_term: 1 leader_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ea07c9cb8f4bc4b91bc515da1a5c6b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38811 } } }
I20260807 18:43:32.164958 14720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:32.166503 14727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:32.171876 14727 catalog_manager.cc:1347] Generated new cluster ID: 54340d8d7d2748d1ad34ac0c889c9e87
I20260807 18:43:32.171940 14727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:32.182809 14727 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:32.183744 14727 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:32.189782 14727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86ea07c9cb8f4bc4b91bc515da1a5c6b: Generated new TSK 0
I20260807 18:43:32.190433 14727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:32.222147 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38811
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:32.332773 14739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:32.333035 14739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:32.333079 14739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:32.336993 14739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:32.337050 14739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:32.337107 14739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:32.342243 14739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:32.343408 14739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:32.344360 14739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:32.353541 14745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.353611 14747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.353544 14744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:32.353603 14739 server_base.cc:1034] running on GCE node
I20260807 18:43:32.354206 14739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:32.354878 14739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:32.356069 14739 hybrid_clock.cc:648] HybridClock initialized: now 1786128212356042 us; error 46 us; skew 500 ppm
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:32.358912 14739 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:32.359833 14739 webserver.cc:460] Webserver started at http://127.10.174.193:36789/ using document root <none> and password file <none>
I20260807 18:43:32.360483 14739 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:32.360577 14739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:32.360821 14739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:32.363057 14739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "a985eb1a00144af6855d84bce00d1c00"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "2aa0bc1eb494d8b0804d9cbecec7edb3"
server_key_iv: "3c1e4d6dbc0d2a56f92a84fdedbfc0de"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.363686 14739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "a985eb1a00144af6855d84bce00d1c00"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "2aa0bc1eb494d8b0804d9cbecec7edb3"
server_key_iv: "3c1e4d6dbc0d2a56f92a84fdedbfc0de"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.367244 14739 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:32.369668 14754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.370846 14739 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:32.370985 14739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "a985eb1a00144af6855d84bce00d1c00"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "2aa0bc1eb494d8b0804d9cbecec7edb3"
server_key_iv: "3c1e4d6dbc0d2a56f92a84fdedbfc0de"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.371090 14739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:32.384842 14739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:32.388055 14739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:32.388252 14739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:32.388931 14739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:32.389732 14739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:32.389802 14739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.389878 14739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:32.389920 14739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.398676 14739 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:35717
I20260807 18:43:32.398695 14873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:35717 every 8 connection(s)
I20260807 18:43:32.399606 14739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:32.409153 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14739
I20260807 18:43:32.409303 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:32.409667 10939 external_mini_cluster.cc:1428] Setting key 008a96349ebef29aaa67b694e4edc799
I20260807 18:43:32.413036 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.401355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:49243 (local address 127.10.174.254:38811)
0807 18:43:32.401496 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:32.401499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:32.402290 (+ 791us) server_negotiation.cc:407] Connection header received
0807 18:43:32.403717 (+ 1427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:32.403721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:32.403777 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:32.403867 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:32.404921 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.405438 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.406484 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.406706 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.406782 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.409137 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:32.409144 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:32.409147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:32.409176 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:32.410690 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.411226 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.411229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.411231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.411349 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.411705 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.411711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.411715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.411964 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:32.412072 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:32.412642 (+ 570us) server_negotiation.cc:299] Negotiation successful
0807 18:43:32.412790 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 18:43:32.413717 14876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.401720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38811 (local address 127.10.174.193:49243)
0807 18:43:32.402146 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:32.402187 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:32.403485 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:32.404012 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:32.404018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:32.404341 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:32.404792 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:32.404805 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.405543 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.405545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:32.406386 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:32.406395 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.406834 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.406837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:32.406973 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.407549 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:32.407564 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:32.408977 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:32.410803 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:32.410807 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:32.410817 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:32.411125 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:32.411456 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:32.411460 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:32.411461 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:32.411605 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:32.412068 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:32.412073 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:32.412347 (+ 274us) client_negotiation.cc:769] Sending connection context
0807 18:43:32.412527 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 18:43:32.412828 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":108,"threads_started":1}
I20260807 18:43:32.414844 14874 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38811
I20260807 18:43:32.415096 14874 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:32.415663 14874 heartbeater.cc:511] Master 127.10.174.254:38811 requested a full tablet report, sending...
I20260807 18:43:32.417114 14676 ts_manager.cc:194] Registered new tserver with Master: a985eb1a00144af6855d84bce00d1c00 (127.10.174.193:35717)
I20260807 18:43:32.418212 14676 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:49243
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:32.435959 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38811
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:32.544291 14879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:32.544555 14879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:32.544598 14879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:32.548583 14879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:32.548640 14879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:32.548698 14879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:32.553964 14879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:32.554976 14879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:32.555963 14879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:32.565285 14885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.565276 14888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.565280 14886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:32.565681 14879 server_base.cc:1034] running on GCE node
I20260807 18:43:32.566093 14879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:32.566674 14879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:32.567827 14879 hybrid_clock.cc:648] HybridClock initialized: now 1786128212567798 us; error 41 us; skew 500 ppm
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:32.570434 14879 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:32.571265 14879 webserver.cc:460] Webserver started at http://127.10.174.194:37065/ using document root <none> and password file <none>
I20260807 18:43:32.571882 14879 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:32.571978 14879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:32.572259 14879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:32.575018 14879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "63f6a50490e3469f90a7e1fab9f87936"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "3c14c15984fc2f453fe7e73742bbf91e"
server_key_iv: "5d6c686de1f362f4bbdf6fcbba5ec8d7"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.575812 14879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "63f6a50490e3469f90a7e1fab9f87936"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "3c14c15984fc2f453fe7e73742bbf91e"
server_key_iv: "5d6c686de1f362f4bbdf6fcbba5ec8d7"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.580802 14879 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:32.583936 14896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.585533 14879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:43:32.585675 14879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "63f6a50490e3469f90a7e1fab9f87936"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "3c14c15984fc2f453fe7e73742bbf91e"
server_key_iv: "5d6c686de1f362f4bbdf6fcbba5ec8d7"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.585798 14879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:32.612758 14879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:32.616181 14879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:32.616386 14879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:32.617008 14879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:32.617823 14879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:32.617869 14879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.617937 14879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:32.617975 14879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.626627 14879 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:40903
I20260807 18:43:32.626670 15016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:40903 every 8 connection(s)
I20260807 18:43:32.627517 14879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:32.632004 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 14879
I20260807 18:43:32.632143 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:32.632427 10939 external_mini_cluster.cc:1428] Setting key 163eeb73aed6056f15cdcd1d6891d334
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:32.640848 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.629137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:45777 (local address 127.10.174.254:38811)
0807 18:43:32.629281 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:32.629286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:32.630088 (+ 802us) server_negotiation.cc:407] Connection header received
0807 18:43:32.631447 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:32.631450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:32.631496 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:32.631569 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:32.632742 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.633395 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.634619 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.635001 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.635122 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.637442 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:32.637450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:32.637453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:32.637475 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:32.638884 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.639391 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.639395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.639396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.639477 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.639814 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.639818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.639819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.639993 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:32.640100 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:32.640562 (+ 462us) server_negotiation.cc:299] Negotiation successful
0807 18:43:32.640673 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 18:43:32.641570 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.629535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38811 (local address 127.10.174.194:45777)
0807 18:43:32.629945 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:32.629985 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:32.631178 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:32.631697 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:32.631703 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:32.632022 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:32.632596 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:32.632612 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.633531 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.633537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:32.634492 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:32.634502 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.635145 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.635148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:32.635336 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.635909 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:32.635924 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:32.637274 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:32.639001 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:32.639007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:32.639020 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:32.639266 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:32.639572 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:32.639576 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:32.639578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:32.639710 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:32.640099 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:32.640105 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:32.640333 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 18:43:32.640502 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 18:43:32.640801 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":102,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:32.642671 15017 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38811
I20260807 18:43:32.642896 15017 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:32.643464 15017 heartbeater.cc:511] Master 127.10.174.254:38811 requested a full tablet report, sending...
I20260807 18:43:32.644567 14676 ts_manager.cc:194] Registered new tserver with Master: 63f6a50490e3469f90a7e1fab9f87936 (127.10.174.194:40903)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
I20260807 18:43:32.645231 14676 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:45777
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:32.660553 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38811
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:32.768672 15022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:32.768929 15022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:32.768998 15022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:32.772974 15022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:32.773049 15022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:32.773175 15022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:32.778368 15022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:32.779326 15022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:32.780267 15022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:32.789045 15028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:32.789064 15031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:32.789232 15022 server_base.cc:1034] running on GCE node
W20260807 18:43:32.789363 15029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:32.789870 15022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:32.790498 15022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:32.791699 15022 hybrid_clock.cc:648] HybridClock initialized: now 1786128212791667 us; error 47 us; skew 500 ppm
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:32.794440 15022 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:32.795398 15022 webserver.cc:460] Webserver started at http://127.10.174.195:41165/ using document root <none> and password file <none>
I20260807 18:43:32.796005 15022 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:32.796099 15022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:32.796303 15022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:32.798249 15022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "e71515c04d544fa1a3532df69e7a144c"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "dacd4d2bfe0bef500599b0fc144fc8bd"
server_key_iv: "785253063b94ad5333e18fa544975c90"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.798805 15022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "e71515c04d544fa1a3532df69e7a144c"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "dacd4d2bfe0bef500599b0fc144fc8bd"
server_key_iv: "785253063b94ad5333e18fa544975c90"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.802286 15022 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:32.804603 15038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.805739 15022 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:32.805868 15022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "e71515c04d544fa1a3532df69e7a144c"
format_stamp: "Formatted at 2026-08-07 18:43:32 on dist-test-slave-07c2"
server_key: "dacd4d2bfe0bef500599b0fc144fc8bd"
server_key_iv: "785253063b94ad5333e18fa544975c90"
server_key_version: "encryptionkey@0"
I20260807 18:43:32.805997 15022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:32.826896 15022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:32.830152 15022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:32.830350 15022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:32.830922 15022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:32.831744 15022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:32.831816 15022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.831884 15022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:32.831933 15022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:32.840826 15022 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:34439
I20260807 18:43:32.840857 15157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:34439 every 8 connection(s)
I20260807 18:43:32.841650 15022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:32.846575 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15022
I20260807 18:43:32.846684 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:32.846977 10939 external_mini_cluster.cc:1428] Setting key f0e76701d421c57a2fb39ad63e65e297
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:32.855341 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.843393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:38051 (local address 127.10.174.254:38811)
0807 18:43:32.843583 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:32.843588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:32.844579 (+ 991us) server_negotiation.cc:407] Connection header received
0807 18:43:32.845847 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:32.845849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:32.845897 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:32.845973 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:32.847210 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.847808 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.848981 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.849204 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.849317 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.851832 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:32.851837 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:32.851845 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:32.851870 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:32.853313 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.853814 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.853818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.853820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.853904 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.854247 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.854252 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.854254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.854435 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:32.854541 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:32.855017 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 18:43:32.855138 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:32.856117 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.843851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38811 (local address 127.10.174.195:38051)
0807 18:43:32.844420 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:32.844459 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:32.845653 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:32.846130 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:32.846137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:32.846487 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:32.847050 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:32.847071 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.847946 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.847949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:32.848850 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:32.848860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.849354 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.849359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:32.849529 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.850133 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:32.850149 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:32.851667 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:32.853436 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:32.853442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:32.853456 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:32.853709 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:32.853998 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:32.854003 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:32.854005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:32.854150 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:32.854540 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:32.854546 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:32.854788 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 18:43:32.854975 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 18:43:32.855323 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":127,"threads_started":1}
I20260807 18:43:32.857223 15158 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38811
I20260807 18:43:32.857446 15158 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:32.857873 15158 heartbeater.cc:511] Master 127.10.174.254:38811 requested a full tablet report, sending...
I20260807 18:43:32.858880 14676 ts_manager.cc:194] Registered new tserver with Master: e71515c04d544fa1a3532df69e7a144c (127.10.174.195:34439)
I20260807 18:43:32.859553 14676 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:38051
I20260807 18:43:32.860821 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:32.886830 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.878025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55378 (local address 127.10.174.193:35717)
0807 18:43:32.878369 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:32.878388 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:32.878417 (+ 29us) server_negotiation.cc:407] Connection header received
0807 18:43:32.878476 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:32.878484 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:32.878688 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:32.878809 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:32.879487 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.880244 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.881022 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.881381 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.881463 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.883764 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:32.883773 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:32.883784 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:32.883805 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:32.885198 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.885611 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.885615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.885616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.885690 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.885921 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.885924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.885925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.886138 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:32.886302 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:32.886547 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 18:43:32.886669 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":168,"threads_started":1}
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[14629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:32.897627 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:32.889605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40442 (local address 127.10.174.254:38811)
0807 18:43:32.889758 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:32.889765 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:32.889783 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:43:32.889907 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:32.889915 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:32.889955 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:32.890037 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:32.890692 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.891273 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.892176 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:32.892404 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:32.892506 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:32.894699 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:32.894701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:32.894703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:32.894726 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:32.896178 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.896534 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.896536 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.896537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.896609 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:32.896848 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:32.896850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:32.896851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:32.897053 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:32.897158 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:32.897413 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 18:43:32.897508 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 18:43:32.898089 14675 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40442
I20260807 18:43:32.898711 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14739
I20260807 18:43:32.905292 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14879
I20260807 18:43:32.912452 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15022
I20260807 18:43:32.917907 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 14643
2026-08-07T18:43:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2128 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[15170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[15170](info): set up 2 sockets
Aug 07 18:43:32 dist-test-slave-07c2 krb5kdc[15170](info): commencing operation
krb5kdc: starting...
W20260807 18:43:33.969913 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:34.088414 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43315
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:34.196146 15183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:34.196471 15183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:34.196556 15183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:34.200613 15183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:34.200716 15183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:34.200755 15183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:34.200795 15183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:34.200840 15183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:34.206240 15183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:34.207403 15183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:34.208451 15183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:34.217000 15192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.216980 15188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.216956 15189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:34.217149 15183 server_base.cc:1034] running on GCE node
I20260807 18:43:34.217877 15183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:34.218941 15183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:34.220094 15183 hybrid_clock.cc:648] HybridClock initialized: now 1786128214220064 us; error 42 us; skew 500 ppm
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:34.222831 15183 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:34.223609 15183 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:34.223712 15183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:34.223943 15183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:34.225893 15183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "4791b1ca49dd4e8e9eeeebe5557b946d"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "a9e827ee822bc81696834fc15776d27c"
server_key_iv: "8ca9c0ec897c63d9f2ab9786659805df"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.226451 15183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "4791b1ca49dd4e8e9eeeebe5557b946d"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "a9e827ee822bc81696834fc15776d27c"
server_key_iv: "8ca9c0ec897c63d9f2ab9786659805df"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.229929 15183 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 18:43:34.232187 15198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.233268 15183 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260807 18:43:34.233403 15183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "4791b1ca49dd4e8e9eeeebe5557b946d"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "a9e827ee822bc81696834fc15776d27c"
server_key_iv: "8ca9c0ec897c63d9f2ab9786659805df"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.233510 15183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:34.248687 15183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:34.251806 15183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:34.251996 15183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:34.258550 15183 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:43315
I20260807 18:43:34.258816 15253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:43315 every 8 connection(s)
I20260807 18:43:34.259187 15183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:34.261729 15254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:34.264228 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15183
I20260807 18:43:34.264385 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:34.264650 10939 external_mini_cluster.cc:1428] Setting key 83c20dc4a801e23cbca965eb7d5cf856
I20260807 18:43:34.267400 15254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: Bootstrap starting.
I20260807 18:43:34.269891 15254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:34.270709 15254 log.cc:824] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:34.272835 15254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: No bootstrap required, opened a new log
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:34.276898 15254 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43315 } }
I20260807 18:43:34.277199 15254 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:34.277261 15254 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4791b1ca49dd4e8e9eeeebe5557b946d, State: Initialized, Role: FOLLOWER
I20260807 18:43:34.277776 15254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43315 } }
I20260807 18:43:34.277936 15254 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:34.278008 15254 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:34.278103 15254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:34.279217 15254 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43315 } }
I20260807 18:43:34.279583 15254 leader_election.cc:302] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4791b1ca49dd4e8e9eeeebe5557b946d; no voters:
I20260807 18:43:34.279894 15254 leader_election.cc:288] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:34.280014 15259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:34.280236 15259 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [term 1 LEADER]: Becoming Leader. State: Replica: 4791b1ca49dd4e8e9eeeebe5557b946d, State: Running, Role: LEADER
I20260807 18:43:34.280370 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.265985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58054 (local address 127.10.174.254:43315)
0807 18:43:34.266381 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.266405 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.266445 (+ 40us) server_negotiation.cc:407] Connection header received
0807 18:43:34.267227 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.267249 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.267663 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.268002 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:34.268678 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.270346 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.271216 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.271788 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.271908 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.274560 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:34.274567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:34.274584 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:34.274616 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:34.277290 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.277698 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.277703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.277709 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.277849 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.278175 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.278179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.278180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.278683 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:34.278881 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.279091 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.279424 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":99,"threads_started":1}
I20260807 18:43:34.280587 15259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43315 } }
I20260807 18:43:34.281114 15254 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:34.282171 15262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4791b1ca49dd4e8e9eeeebe5557b946d. Latest consensus state: current_term: 1 leader_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43315 } } }
I20260807 18:43:34.282312 15262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:34.282622 15261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4791b1ca49dd4e8e9eeeebe5557b946d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43315 } } }
I20260807 18:43:34.282698 15261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d [sys.catalog]: This master's current role is: LEADER
W20260807 18:43:34.286027 15275 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:34.286108 15275 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:34.286163 15269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:34.287017 15269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:34.292526 15269 catalog_manager.cc:1347] Generated new cluster ID: 98a0d684bb0f453c87e79626e0c1c316
I20260807 18:43:34.292601 15269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:34.303447 15269 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:34.304348 15269 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:34.311049 15269 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: Generated new TSK 0
I20260807 18:43:34.311748 15269 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:34.343276 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43315
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:34.460070 15281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:34.460348 15281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:34.460444 15281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:34.464887 15281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:34.464951 15281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:34.465013 15281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:34.470142 15281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:34.471163 15281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:34.472172 15281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:34.481328 15289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.481312 15286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.481312 15287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:34.481665 15281 server_base.cc:1034] running on GCE node
I20260807 18:43:34.482113 15281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:34.482673 15281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:34.483836 15281 hybrid_clock.cc:648] HybridClock initialized: now 1786128214483801 us; error 44 us; skew 500 ppm
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:34.486512 15281 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:34.487221 15281 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:34.487323 15281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:34.487560 15281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:34.489562 15281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "3a64c85508ec4f3f901bc7d05639a8cd"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "c8782884b86d7ec6b5b6d9cb02709d3c"
server_key_iv: "8acce7ab0c7226615e2baf60ab5352df"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.490144 15281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "3a64c85508ec4f3f901bc7d05639a8cd"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "c8782884b86d7ec6b5b6d9cb02709d3c"
server_key_iv: "8acce7ab0c7226615e2baf60ab5352df"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.493764 15281 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 18:43:34.496043 15295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.497179 15281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260807 18:43:34.497314 15281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "3a64c85508ec4f3f901bc7d05639a8cd"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "c8782884b86d7ec6b5b6d9cb02709d3c"
server_key_iv: "8acce7ab0c7226615e2baf60ab5352df"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.497424 15281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:34.511528 15281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:34.514168 15281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:34.514359 15281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:34.514940 15281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:34.515826 15281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:34.515905 15281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.515976 15281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:34.516019 15281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.524793 15281 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:39623
I20260807 18:43:34.524818 15411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:39623 every 8 connection(s)
I20260807 18:43:34.525362 15281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:34.530673 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15281
I20260807 18:43:34.530805 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:34.531144 10939 external_mini_cluster.cc:1428] Setting key e25202ae924754ec9f9cf3e1285ab716
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:34.541380 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.527142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:44677 (local address 127.10.174.254:43315)
0807 18:43:34.527331 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.527336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.528192 (+ 856us) server_negotiation.cc:407] Connection header received
0807 18:43:34.529487 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.529491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.529551 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.529631 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:34.530944 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.531744 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.533288 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.533518 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.533602 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.536835 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:34.536838 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:34.536840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:34.536865 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:34.539102 (+ 2237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.539711 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.539714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.539720 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.539816 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.540160 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.540163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.540165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.540417 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:34.540526 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.541076 (+ 550us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.541207 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:43:34.542299 15414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.527609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43315 (local address 127.10.174.193:44677)
0807 18:43:34.528032 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:34.528074 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:34.529277 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:34.529796 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:34.529803 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:34.530137 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:34.530739 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.530761 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.531878 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.531881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.533137 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.533152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.533676 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.533683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.533921 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.534546 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:34.534572 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:34.536641 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:34.539248 (+ 2607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:34.539256 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:34.539274 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:34.539590 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:34.539895 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:34.539899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:34.539901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:34.540052 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:34.540525 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:34.540533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:34.540801 (+ 268us) client_negotiation.cc:769] Sending connection context
0807 18:43:34.541008 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 18:43:34.541343 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:34.543814 15412 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43315
I20260807 18:43:34.544090 15412 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:34.544587 15412 heartbeater.cc:511] Master 127.10.174.254:43315 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:43:34.546180 15215 ts_manager.cc:194] Registered new tserver with Master: 3a64c85508ec4f3f901bc7d05639a8cd (127.10.174.193:39623)
I20260807 18:43:34.547403 15215 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:44677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:34.561587 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43315
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:34.669413 15417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:34.669653 15417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:34.669696 15417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:34.673813 15417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:34.673871 15417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:34.673929 15417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:34.679209 15417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:34.680184 15417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:34.681151 15417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:34.690292 15422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.690300 15425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.690292 15423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:34.690627 15417 server_base.cc:1034] running on GCE node
I20260807 18:43:34.691022 15417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:34.691694 15417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:34.692878 15417 hybrid_clock.cc:648] HybridClock initialized: now 1786128214692868 us; error 30 us; skew 500 ppm
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:34.695546 15417 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:34.696233 15417 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:34.696331 15417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:34.696552 15417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:34.698489 15417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "b4357abd366746beb93b926503ed4df8"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "b20b251160e1ed1bc890b45d0cb3fd24"
server_key_iv: "55a161621a235f65f72fa77ca856af19"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.699054 15417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "b4357abd366746beb93b926503ed4df8"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "b20b251160e1ed1bc890b45d0cb3fd24"
server_key_iv: "55a161621a235f65f72fa77ca856af19"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.702710 15417 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:34.704988 15431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.706138 15417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 18:43:34.706271 15417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "b4357abd366746beb93b926503ed4df8"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "b20b251160e1ed1bc890b45d0cb3fd24"
server_key_iv: "55a161621a235f65f72fa77ca856af19"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.706377 15417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:34.718099 15417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:34.720693 15417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:34.720889 15417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:34.721432 15417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:34.722213 15417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:34.722280 15417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.722349 15417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:34.722390 15417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.730866 15417 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:34371
I20260807 18:43:34.730891 15552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:34371 every 8 connection(s)
I20260807 18:43:34.731432 15417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:34.738008 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15417
I20260807 18:43:34.738148 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:34.738443 10939 external_mini_cluster.cc:1428] Setting key 98210f3b4acbc731e2ba9e772699d70e
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:34.745115 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.733027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:60021 (local address 127.10.174.254:43315)
0807 18:43:34.733195 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.733200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.733947 (+ 747us) server_negotiation.cc:407] Connection header received
0807 18:43:34.735137 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.735140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.735186 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.735260 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:34.736429 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.736951 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.738083 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.738406 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.738519 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.741134 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:34.741137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:34.741140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:34.741173 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:34.742912 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.743515 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.743517 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.743519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.743593 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.743986 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.743988 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.743989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.744150 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:34.744227 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.744896 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.745000 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 18:43:34.745988 15555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.733387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43315 (local address 127.10.174.194:60021)
0807 18:43:34.733797 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:34.733838 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:34.734952 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:34.735465 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:34.735471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:34.735803 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:34.736305 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.736318 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.737085 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.737088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.737954 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.737963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.738568 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.738572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.738736 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.739382 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:34.739401 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:34.740963 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:34.743041 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:34.743045 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:34.743055 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:34.743417 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:34.743689 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:34.743695 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:34.743700 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:34.743887 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:34.744266 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:34.744274 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:34.744602 (+ 328us) client_negotiation.cc:769] Sending connection context
0807 18:43:34.744811 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 18:43:34.745162 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":107,"threads_started":1}
I20260807 18:43:34.747048 15553 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43315
I20260807 18:43:34.747323 15553 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:34.747769 15553 heartbeater.cc:511] Master 127.10.174.254:43315 requested a full tablet report, sending...
I20260807 18:43:34.748837 15215 ts_manager.cc:194] Registered new tserver with Master: b4357abd366746beb93b926503ed4df8 (127.10.174.194:34371)
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:34.749591 15215 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:60021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:34.764415 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43315
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:34.874245 15558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:34.874534 15558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:34.874632 15558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:34.878728 15558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:34.878814 15558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:34.878901 15558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:34.884204 15558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43315
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:34.885202 15558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:34.886173 15558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:34.895112 15563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:34.895131 15566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:34.895324 15558 server_base.cc:1034] running on GCE node
W20260807 18:43:34.895112 15564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:34.895824 15558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:34.896411 15558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:34.897589 15558 hybrid_clock.cc:648] HybridClock initialized: now 1786128214897576 us; error 26 us; skew 500 ppm
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:34.900504 15558 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:34.901276 15558 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:34.901368 15558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:34.901577 15558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:34.903579 15558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "177dea9189d0422bbb5cd3ce2c3907e1"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "59552f752abc15d8b47528480f2c184c"
server_key_iv: "b2f322079cd48b05b2c2df8c29385845"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.904134 15558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "177dea9189d0422bbb5cd3ce2c3907e1"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "59552f752abc15d8b47528480f2c184c"
server_key_iv: "b2f322079cd48b05b2c2df8c29385845"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.907569 15558 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 18:43:34.909834 15572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.911036 15558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:34.911165 15558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "177dea9189d0422bbb5cd3ce2c3907e1"
format_stamp: "Formatted at 2026-08-07 18:43:34 on dist-test-slave-07c2"
server_key: "59552f752abc15d8b47528480f2c184c"
server_key_iv: "b2f322079cd48b05b2c2df8c29385845"
server_key_version: "encryptionkey@0"
I20260807 18:43:34.911279 15558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:34.925535 15558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:34.928623 15558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:34.928810 15558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:34.929347 15558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:34.930166 15558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:34.930230 15558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.930306 15558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:34.930361 15558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:34.939211 15558 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:33239
I20260807 18:43:34.939248 15693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:33239 every 8 connection(s)
I20260807 18:43:34.939805 15558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:34.940366 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15558
I20260807 18:43:34.940479 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:34.940815 10939 external_mini_cluster.cc:1428] Setting key 737f055f00963ff29e5f026225063266
Aug 07 18:43:34 dist-test-slave-07c2 krb5kdc[15170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128214, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:34.952875 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.943041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:49753 (local address 127.10.174.254:43315)
0807 18:43:34.943166 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.943182 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.943194 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:43:34.944197 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.944199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.944238 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.944310 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:34.945373 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.945873 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.947028 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.947233 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.947359 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.949765 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:34.949768 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:34.949770 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:34.949791 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:34.951216 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.951690 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.951693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.951694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.951769 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.952046 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.952048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.952049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.952200 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:34.952277 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.952676 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.952764 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 18:43:34.953635 15696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.942152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43315 (local address 127.10.174.195:49753)
0807 18:43:34.942694 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:34.942751 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:34.944033 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:34.944454 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:34.944460 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:34.944816 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:34.945251 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.945264 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.945985 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.945987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.946920 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.946929 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.947403 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.947406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.947539 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.948064 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:34.948079 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:34.949619 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:34.951357 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:34.951362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:34.951377 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:34.951608 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:34.951846 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:34.951848 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:34.951849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:34.951970 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:34.952291 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:34.952296 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:34.952492 (+ 196us) client_negotiation.cc:769] Sending connection context
0807 18:43:34.952630 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 18:43:34.952856 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":131,"threads_started":1}
I20260807 18:43:34.954722 15694 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43315
I20260807 18:43:34.954947 15694 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:34.955430 15694 heartbeater.cc:511] Master 127.10.174.254:43315 requested a full tablet report, sending...
I20260807 18:43:34.956374 15214 ts_manager.cc:194] Registered new tserver with Master: 177dea9189d0422bbb5cd3ce2c3907e1 (127.10.174.195:33239)
I20260807 18:43:34.956882 15214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:49753
I20260807 18:43:34.966123 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:43:34.974669 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.968061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.10.174.254:43315)
0807 18:43:34.968193 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.968198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.968364 (+ 166us) server_negotiation.cc:407] Connection header received
0807 18:43:34.968452 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.968454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.968489 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.968563 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:34.969182 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.969652 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.970397 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.970591 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.970662 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.971908 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:34.971910 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:34.971912 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:34.971932 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:34.973305 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.973678 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.973680 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.973681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.973749 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:34.973972 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:34.973974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:34.973975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:34.974152 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:34.974257 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.974404 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.974482 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:43:34.977411 15214 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:34.980412 15214 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:34.994041 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.988324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:34371 (local address 127.0.0.1:49064)
0807 18:43:34.988780 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:34.988827 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:34.988948 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:34.989594 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:34.989601 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:34.989628 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:34.989788 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.989799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.991056 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.991059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.992411 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.992420 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.993488 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.993492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.993605 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.993645 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 18:43:34.993770 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 18:43:34.993892 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":1,"thread_start_us":60,"threads_started":1}
I20260807 18:43:34.994061 15707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.988445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49064 (local address 127.10.174.194:34371)
0807 18:43:34.988909 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.988918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.989094 (+ 176us) server_negotiation.cc:407] Connection header received
0807 18:43:34.989187 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.989193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.989397 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.989556 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:34.989926 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.990916 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.992548 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.993355 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.993501 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.993636 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.993820 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.993912 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":128,"threads_started":1}
I20260807 18:43:34.994475 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.988405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:33239 (local address 127.0.0.1:43456)
0807 18:43:34.989586 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:34.989602 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:34.989697 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:34.990640 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:34.990663 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:34.990686 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:34.990779 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.990786 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.992045 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.992049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.992977 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.992986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.994051 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.994057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.994175 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.994208 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 18:43:34.994277 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 18:43:34.994334 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"spinlock_wait_cycles":8960,"thread_start_us":128,"threads_started":1}
I20260807 18:43:34.994850 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.988989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:39623 (local address 127.0.0.1:43650)
0807 18:43:34.989908 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:34.989922 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:34.989999 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:34.990475 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:34.990478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:34.990498 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:34.990587 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.990593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.992022 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.992026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.993381 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:34.993394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.994441 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.994445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:34.994537 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.994558 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:43:34.994641 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 18:43:34.994710 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":205,"thread_start_us":98,"threads_started":1}
I20260807 18:43:34.994889 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.989195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43650 (local address 127.10.174.193:39623)
0807 18:43:34.989960 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.989971 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.989995 (+ 24us) server_negotiation.cc:407] Connection header received
0807 18:43:34.990135 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.990141 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.990326 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.990475 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:34.990717 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.991876 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.993513 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.994320 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.994451 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.994563 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.994666 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.994745 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":120,"threads_started":1}
I20260807 18:43:34.994900 15710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:34.989271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43456 (local address 127.10.174.195:33239)
0807 18:43:34.990100 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:34.990111 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:34.990131 (+ 20us) server_negotiation.cc:407] Connection header received
0807 18:43:34.990190 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:34.990194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:34.990331 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:34.990475 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:34.990905 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.991722 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.993101 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:34.993780 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:34.993884 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:34.993988 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:34.994666 (+ 678us) server_negotiation.cc:299] Negotiation successful
0807 18:43:34.994761 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":112,"threads_started":1}
I20260807 18:43:34.997018 15483 tablet_service.cc:1467] Processing CreateTablet for tablet db2e2c5c367048ef9fb31acd7dab27b9 (DEFAULT_TABLE table=test-table [id=bbc8764383fb496ea0b3d6e8323ed409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:34.997170 15345 tablet_service.cc:1467] Processing CreateTablet for tablet db2e2c5c367048ef9fb31acd7dab27b9 (DEFAULT_TABLE table=test-table [id=bbc8764383fb496ea0b3d6e8323ed409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:34.997869 15483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db2e2c5c367048ef9fb31acd7dab27b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:34.997923 15345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db2e2c5c367048ef9fb31acd7dab27b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:35.001263 15623 tablet_service.cc:1467] Processing CreateTablet for tablet db2e2c5c367048ef9fb31acd7dab27b9 (DEFAULT_TABLE table=test-table [id=bbc8764383fb496ea0b3d6e8323ed409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:35.002230 15623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db2e2c5c367048ef9fb31acd7dab27b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:35.005178 15712 tablet_bootstrap.cc:492] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Bootstrap starting.
I20260807 18:43:35.005381 15711 tablet_bootstrap.cc:492] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: Bootstrap starting.
I20260807 18:43:35.007051 15711 tablet_bootstrap.cc:654] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.007781 15712 tablet_bootstrap.cc:654] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.008205 15711 log.cc:824] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.008594 15712 log.cc:824] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.009912 15714 tablet_bootstrap.cc:492] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Bootstrap starting.
I20260807 18:43:35.010195 15711 tablet_bootstrap.cc:492] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: No bootstrap required, opened a new log
I20260807 18:43:35.010390 15711 ts_tablet_manager.cc:1397] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:43:35.010533 15712 tablet_bootstrap.cc:492] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: No bootstrap required, opened a new log
I20260807 18:43:35.010696 15712 ts_tablet_manager.cc:1397] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:43:35.011804 15714 tablet_bootstrap.cc:654] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.012707 15714 log.cc:824] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.014262 15714 tablet_bootstrap.cc:492] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: No bootstrap required, opened a new log
I20260807 18:43:35.014290 15712 raft_consensus.cc:348] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.014290 15711 raft_consensus.cc:348] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.014539 15714 ts_tablet_manager.cc:1397] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:35.014570 15711 raft_consensus.cc:374] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:35.014611 15712 raft_consensus.cc:374] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:35.014624 15711 raft_consensus.cc:729] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a64c85508ec4f3f901bc7d05639a8cd, State: Initialized, Role: FOLLOWER
I20260807 18:43:35.014660 15712 raft_consensus.cc:729] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4357abd366746beb93b926503ed4df8, State: Initialized, Role: FOLLOWER
I20260807 18:43:35.015106 15711 consensus_queue.cc:260] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.015113 15712 consensus_queue.cc:260] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.015894 15553 heartbeater.cc:503] Master 127.10.174.254:43315 was elected leader, sending a full tablet report...
I20260807 18:43:35.016105 15711 ts_tablet_manager.cc:1428] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:43:35.016105 15712 ts_tablet_manager.cc:1428] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:43:35.016431 15412 heartbeater.cc:503] Master 127.10.174.254:43315 was elected leader, sending a full tablet report...
I20260807 18:43:35.018836 15714 raft_consensus.cc:348] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.019132 15714 raft_consensus.cc:374] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:35.019219 15714 raft_consensus.cc:729] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 177dea9189d0422bbb5cd3ce2c3907e1, State: Initialized, Role: FOLLOWER
I20260807 18:43:35.019657 15714 consensus_queue.cc:260] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.020326 15694 heartbeater.cc:503] Master 127.10.174.254:43315 was elected leader, sending a full tablet report...
I20260807 18:43:35.020615 15714 ts_tablet_manager.cc:1428] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
W20260807 18:43:35.026409 15413 tablet.cc:2369] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:35.081442 15718 raft_consensus.cc:482] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:35.081624 15718 raft_consensus.cc:504] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.082906 15718 leader_election.cc:288] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4357abd366746beb93b926503ed4df8 (127.10.174.194:34371), 177dea9189d0422bbb5cd3ce2c3907e1 (127.10.174.195:33239)
I20260807 18:43:35.086498 15707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.083384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:56189 (local address 127.10.174.194:34371)
0807 18:43:35.083537 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.083544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.083562 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:43:35.083618 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.083621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.083666 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.083735 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:35.084024 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.084514 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.085556 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.085954 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.086081 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:35.086132 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.086315 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.086381 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 18:43:35.086520 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.083064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:34371 (local address 127.10.174.193:56189)
0807 18:43:35.083400 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.083416 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.083512 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.083748 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.083752 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.083770 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:35.083908 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:35.083914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.084627 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.084632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:35.085429 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:35.085437 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.086074 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.086078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:35.086172 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:35.086202 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.086297 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.086367 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":110,"threads_started":1}
I20260807 18:43:35.086887 15710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.083533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:46439 (local address 127.10.174.195:33239)
0807 18:43:35.083687 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.083691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.083879 (+ 188us) server_negotiation.cc:407] Connection header received
0807 18:43:35.084006 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.084009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.084057 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.084132 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:35.084407 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.084897 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.085907 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.086318 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.086442 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:35.086488 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.086704 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.086771 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:43:35.087164 15504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2e2c5c367048ef9fb31acd7dab27b9" candidate_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4357abd366746beb93b926503ed4df8" is_pre_election: true
I20260807 18:43:35.087260 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.083193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:33239 (local address 127.10.174.193:46439)
0807 18:43:35.083776 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.083789 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.083920 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.084153 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.084156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.084177 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:35.084299 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:35.084304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.085004 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.085010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:35.085780 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:35.085789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.086435 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.086438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:35.086540 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:35.086568 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.087077 (+ 509us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.087155 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":134,"threads_started":1}
I20260807 18:43:35.087502 15504 raft_consensus.cc:2454] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a64c85508ec4f3f901bc7d05639a8cd in term 0.
I20260807 18:43:35.087934 15645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2e2c5c367048ef9fb31acd7dab27b9" candidate_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" is_pre_election: true
I20260807 18:43:35.087991 15298 leader_election.cc:302] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a64c85508ec4f3f901bc7d05639a8cd, b4357abd366746beb93b926503ed4df8; no voters:
I20260807 18:43:35.088182 15645 raft_consensus.cc:2454] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a64c85508ec4f3f901bc7d05639a8cd in term 0.
I20260807 18:43:35.088279 15718 raft_consensus.cc:2781] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:35.088369 15718 raft_consensus.cc:482] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:35.088424 15718 raft_consensus.cc:3037] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:35.089506 15718 raft_consensus.cc:504] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.089872 15718 leader_election.cc:288] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [CANDIDATE]: Term 1 election: Requested vote from peers b4357abd366746beb93b926503ed4df8 (127.10.174.194:34371), 177dea9189d0422bbb5cd3ce2c3907e1 (127.10.174.195:33239)
I20260807 18:43:35.090170 15504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2e2c5c367048ef9fb31acd7dab27b9" candidate_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4357abd366746beb93b926503ed4df8"
I20260807 18:43:35.090206 15645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db2e2c5c367048ef9fb31acd7dab27b9" candidate_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "177dea9189d0422bbb5cd3ce2c3907e1"
I20260807 18:43:35.090306 15504 raft_consensus.cc:3037] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:35.090332 15645 raft_consensus.cc:3037] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:35.091420 15504 raft_consensus.cc:2454] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a64c85508ec4f3f901bc7d05639a8cd in term 1.
I20260807 18:43:35.091449 15645 raft_consensus.cc:2454] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a64c85508ec4f3f901bc7d05639a8cd in term 1.
I20260807 18:43:35.091724 15297 leader_election.cc:302] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 177dea9189d0422bbb5cd3ce2c3907e1, 3a64c85508ec4f3f901bc7d05639a8cd; no voters:
I20260807 18:43:35.091897 15718 raft_consensus.cc:2781] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:35.092115 15718 raft_consensus.cc:686] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [term 1 LEADER]: Becoming Leader. State: Replica: 3a64c85508ec4f3f901bc7d05639a8cd, State: Running, Role: LEADER
I20260807 18:43:35.092427 15718 consensus_queue.cc:237] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } }
I20260807 18:43:35.095571 15215 catalog_manager.cc:5495] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a64c85508ec4f3f901bc7d05639a8cd (127.10.174.193). New cstate: current_term: 1 leader_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a64c85508ec4f3f901bc7d05639a8cd" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39623 } health_report { overall_health: HEALTHY } } }
I20260807 18:43:35.114707 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.111542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43652 (local address 127.10.174.193:39623)
0807 18:43:35.111683 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.111687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.111699 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:43:35.111775 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.111777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.111825 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.111910 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:35.112132 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.112610 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.113388 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:35.113590 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:35.113676 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:35.113977 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:35.114404 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:35.114493 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.114552 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.114596 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:35.120217 15645 raft_consensus.cc:1261] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 1 FOLLOWER]: Refusing update from remote peer 3a64c85508ec4f3f901bc7d05639a8cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:35.120215 15504 raft_consensus.cc:1261] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 1 FOLLOWER]: Refusing update from remote peer 3a64c85508ec4f3f901bc7d05639a8cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:35.120867 15718 consensus_queue.cc:1035] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "177dea9189d0422bbb5cd3ce2c3907e1" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:35.121070 15722 consensus_queue.cc:1035] T db2e2c5c367048ef9fb31acd7dab27b9 P 3a64c85508ec4f3f901bc7d05639a8cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4357abd366746beb93b926503ed4df8" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:35.128168 15726 mvcc.cc:205] Tried to move back new op lower bound from 7315981169125212160 to 7315981169021235200. Current Snapshot: MvccSnapshot[applied={T|T < 7315981169125212160}]
I20260807 18:43:35.130383 15727 mvcc.cc:205] Tried to move back new op lower bound from 7315981169125212160 to 7315981169021235200. Current Snapshot: MvccSnapshot[applied={T|T < 7315981169125212160}]
I20260807 18:43:35.135977 15215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:35.136114 15215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:35.138429 15215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4791b1ca49dd4e8e9eeeebe5557b946d: Sending DeleteTablet for 3 replicas of tablet db2e2c5c367048ef9fb31acd7dab27b9
I20260807 18:43:35.139113 15483 tablet_service.cc:1514] Processing DeleteTablet for tablet db2e2c5c367048ef9fb31acd7dab27b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:35 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:49064
I20260807 18:43:35.139258 15623 tablet_service.cc:1514] Processing DeleteTablet for tablet db2e2c5c367048ef9fb31acd7dab27b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:35 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:43456
I20260807 18:43:35.139390 15345 tablet_service.cc:1514] Processing DeleteTablet for tablet db2e2c5c367048ef9fb31acd7dab27b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:35 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:43650
I20260807 18:43:35.139628 15735 tablet_replica.cc:330] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: stopping tablet replica
I20260807 18:43:35.139745 15736 tablet_replica.cc:330] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: stopping tablet replica
I20260807 18:43:35.140033 15735 raft_consensus.cc:2229] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:35.140040 15736 raft_consensus.cc:2229] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:35.140161 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15281
I20260807 18:43:35.140343 15736 raft_consensus.cc:2258] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:35.141793 15735 raft_consensus.cc:2258] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:35.143356 15736 ts_tablet_manager.cc:1905] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:35.143633 15735 ts_tablet_manager.cc:1905] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:35.145713 15736 ts_tablet_manager.cc:1918] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:35.145834 15736 log.cc:1196] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/db2e2c5c367048ef9fb31acd7dab27b9
I20260807 18:43:35.146142 15736 ts_tablet_manager.cc:1939] T db2e2c5c367048ef9fb31acd7dab27b9 P 177dea9189d0422bbb5cd3ce2c3907e1: Deleting consensus metadata
I20260807 18:43:35.147055 15735 ts_tablet_manager.cc:1918] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:35.147151 15735 log.cc:1196] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/db2e2c5c367048ef9fb31acd7dab27b9
I20260807 18:43:35.147264 15200 catalog_manager.cc:4841] TS 177dea9189d0422bbb5cd3ce2c3907e1 (127.10.174.195:33239): tablet db2e2c5c367048ef9fb31acd7dab27b9 (table test-table [id=bbc8764383fb496ea0b3d6e8323ed409]) successfully deleted
I20260807 18:43:35.147501 15735 ts_tablet_manager.cc:1939] T db2e2c5c367048ef9fb31acd7dab27b9 P b4357abd366746beb93b926503ed4df8: Deleting consensus metadata
I20260807 18:43:35.148715 15201 catalog_manager.cc:4841] TS b4357abd366746beb93b926503ed4df8 (127.10.174.194:34371): tablet db2e2c5c367048ef9fb31acd7dab27b9 (table test-table [id=bbc8764383fb496ea0b3d6e8323ed409]) successfully deleted
W20260807 18:43:35.150115 15200 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:39623 (error 108)
I20260807 18:43:35.150177 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15417
I20260807 18:43:35.152313 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.151859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:39623 (local address 127.0.0.1:43660)
0807 18:43:35.152090 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.152183 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260807 18:43:35.152515 15200 catalog_manager.cc:4584] TS 3a64c85508ec4f3f901bc7d05639a8cd (127.10.174.193:39623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet db2e2c5c367048ef9fb31acd7dab27b9: Network error: Client connection negotiation failed: client connection to 127.10.174.193:39623: connect: Connection refused (error 111)
I20260807 18:43:35.157724 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15558
I20260807 18:43:35.164006 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15183
2026-08-07T18:43:35Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2245 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T18:43:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:35Z Disabled control of system clock
I20260807 18:43:35.194763 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:46627
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:46627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 18:43:35.303722 15742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:35.303963 15742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:35.303998 15742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:35.307868 15742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:35.307912 15742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:35.307927 15742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:35.307943 15742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:35.307958 15742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:35.312567 15742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:46627
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:46627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:35.313472 15742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:35.314699 15742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:35.322849 15748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:35.322858 15747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:35.322852 15751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:35.323127 15742 server_base.cc:1034] running on GCE node
I20260807 18:43:35.323745 15742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:35.324777 15742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:35.325979 15742 hybrid_clock.cc:648] HybridClock initialized: now 1786128215325962 us; error 35 us; skew 500 ppm
I20260807 18:43:35.328078 15742 webserver.cc:460] Webserver started at http://127.10.174.254:44503/ using document root <none> and password file <none>
I20260807 18:43:35.328694 15742 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:35.328794 15742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:35.329028 15742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:35.331051 15742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "e225fae0c17740aca70dc8d038981dc5"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "9ec6ad63045aaa06cc9a29d960bfef97"
server_key_iv: "c2700032ff130332a0ba68efe1c08220"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.331676 15742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "e225fae0c17740aca70dc8d038981dc5"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "9ec6ad63045aaa06cc9a29d960bfef97"
server_key_iv: "c2700032ff130332a0ba68efe1c08220"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.335413 15742 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:35.337872 15757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.339047 15742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:35.339206 15742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "e225fae0c17740aca70dc8d038981dc5"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "9ec6ad63045aaa06cc9a29d960bfef97"
server_key_iv: "c2700032ff130332a0ba68efe1c08220"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.339394 15742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:35.343964 15742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:35.344570 15742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:35.344754 15742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:35.351719 15742 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:46627
I20260807 18:43:35.351728 15811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:46627 every 8 connection(s)
I20260807 18:43:35.352643 15742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:35.355738 15812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:35.360492 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15742
I20260807 18:43:35.360651 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:35.360942 10939 external_mini_cluster.cc:1428] Setting key b4ec87492e70802ce6b003f34a95c5bd
I20260807 18:43:35.361092 15812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5: Bootstrap starting.
I20260807 18:43:35.363899 15812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.364775 15812 log.cc:824] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.367035 15812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5: No bootstrap required, opened a new log
I20260807 18:43:35.367386 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.362389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45756 (local address 127.10.174.254:46627)
0807 18:43:35.363090 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.363111 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.363155 (+ 44us) server_negotiation.cc:407] Connection header received
0807 18:43:35.364109 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.364137 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.364574 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.364946 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.365907 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.365912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.365927 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.365937 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.365995 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.366016 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.366122 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.366255 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.366489 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":170,"threads_started":1}
I20260807 18:43:35.370601 15812 raft_consensus.cc:348] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e225fae0c17740aca70dc8d038981dc5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 46627 } }
I20260807 18:43:35.370802 15812 raft_consensus.cc:374] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:35.370836 15812 raft_consensus.cc:729] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e225fae0c17740aca70dc8d038981dc5, State: Initialized, Role: FOLLOWER
I20260807 18:43:35.371227 15812 consensus_queue.cc:260] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e225fae0c17740aca70dc8d038981dc5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 46627 } }
I20260807 18:43:35.371409 15812 raft_consensus.cc:388] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:35.371464 15812 raft_consensus.cc:482] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:35.371533 15812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:35.372397 15812 raft_consensus.cc:504] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e225fae0c17740aca70dc8d038981dc5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 46627 } }
I20260807 18:43:35.372701 15812 leader_election.cc:302] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e225fae0c17740aca70dc8d038981dc5; no voters:
I20260807 18:43:35.373047 15812 leader_election.cc:288] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:35.373129 15818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:35.373383 15818 raft_consensus.cc:686] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [term 1 LEADER]: Becoming Leader. State: Replica: e225fae0c17740aca70dc8d038981dc5, State: Running, Role: LEADER
I20260807 18:43:35.373696 15818 consensus_queue.cc:237] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e225fae0c17740aca70dc8d038981dc5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 46627 } }
I20260807 18:43:35.374243 15812 sys_catalog.cc:564] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:35.375468 15819 sys_catalog.cc:455] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e225fae0c17740aca70dc8d038981dc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e225fae0c17740aca70dc8d038981dc5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 46627 } } }
I20260807 18:43:35.375598 15819 sys_catalog.cc:458] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:35.375891 15820 sys_catalog.cc:455] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e225fae0c17740aca70dc8d038981dc5. Latest consensus state: current_term: 1 leader_uuid: "e225fae0c17740aca70dc8d038981dc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e225fae0c17740aca70dc8d038981dc5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 46627 } } }
I20260807 18:43:35.375981 15820 sys_catalog.cc:458] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:35.376119 15827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:35.379134 15827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:35.384687 15827 catalog_manager.cc:1347] Generated new cluster ID: 5fa1b079bcbd49dc8f7342e198196e88
I20260807 18:43:35.384774 15827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:35.418802 15827 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:35.419147 15827 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:35.423574 15827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5: Generated new TSK 0
I20260807 18:43:35.424194 15827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:43:35.432130 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:46627
--builtin_ntp_servers=127.10.174.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 18:43:35.551019 15837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:35.551268 15837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:35.551374 15837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:35.555388 15837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:35.555438 15837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:35.555495 15837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:35.560449 15837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:46627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:35.561503 15837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:35.562825 15837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:35.572230 15848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:35.572412 15837 server_base.cc:1034] running on GCE node
W20260807 18:43:35.572238 15845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:35.572768 15843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:35.573305 15837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:35.574100 15837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:35.575304 15837 hybrid_clock.cc:648] HybridClock initialized: now 1786128215575263 us; error 56 us; skew 500 ppm
I20260807 18:43:35.577647 15837 webserver.cc:460] Webserver started at http://127.10.174.193:44671/ using document root <none> and password file <none>
I20260807 18:43:35.578351 15837 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:35.578456 15837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:35.578686 15837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:35.580955 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "ad14d3002a844a45a1c5785e6817af1a"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "0d110afacebd74781722cf6c036c1b89"
server_key_iv: "8da1d81f4b9cfe0143d9b3f8e0e328d5"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.581512 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "ad14d3002a844a45a1c5785e6817af1a"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "0d110afacebd74781722cf6c036c1b89"
server_key_iv: "8da1d81f4b9cfe0143d9b3f8e0e328d5"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.585114 15837 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260807 18:43:35.587545 15854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.588639 15837 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:43:35.588788 15837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "ad14d3002a844a45a1c5785e6817af1a"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "0d110afacebd74781722cf6c036c1b89"
server_key_iv: "8da1d81f4b9cfe0143d9b3f8e0e328d5"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.588902 15837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:35.593232 15837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:35.593809 15837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:35.593986 15837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:35.594499 15837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:35.595398 15837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:35.595464 15837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.595525 15837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:35.595575 15837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.604259 15837 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:38073
I20260807 18:43:35.604302 15970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:38073 every 8 connection(s)
I20260807 18:43:35.605104 15837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:35.609511 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15837
I20260807 18:43:35.609640 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:35.609980 10939 external_mini_cluster.cc:1428] Setting key 273b20d0e4975e523d08e546294631a3
I20260807 18:43:35.611042 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.606724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:40509 (local address 127.10.174.254:46627)
0807 18:43:35.606891 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.606896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.607887 (+ 991us) server_negotiation.cc:407] Connection header received
0807 18:43:35.609207 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.609210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.609245 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.609312 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.610580 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.610583 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.610586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.610599 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.610622 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.610632 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.610752 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.610904 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.610941 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 18:43:35.611979 15973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.607098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:46627 (local address 127.10.174.193:40509)
0807 18:43:35.607731 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.607770 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.609026 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.609482 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.609492 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.609605 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:35.610273 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:35.610275 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:35.610313 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:35.610415 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:35.610759 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:35.610768 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:35.610773 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.610937 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.611147 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":150,"threads_started":1}
I20260807 18:43:35.612105 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:46627
--builtin_ntp_servers=127.10.174.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 18:43:35.613078 15971 heartbeater.cc:347] Connected to a master server at 127.10.174.254:46627
I20260807 18:43:35.613302 15971 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:35.613739 15971 heartbeater.cc:511] Master 127.10.174.254:46627 requested a full tablet report, sending...
I20260807 18:43:35.615232 15775 ts_manager.cc:194] Registered new tserver with Master: ad14d3002a844a45a1c5785e6817af1a (127.10.174.193:38073)
W20260807 18:43:35.721238 15974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:35.721479 15974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:35.721519 15974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:35.725414 15974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:35.725456 15974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:35.725526 15974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:35.730197 15974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:46627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:35.731177 15974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:35.732545 15974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:35.741915 15983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:35.741899 15981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:35.741976 15980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:35.742218 15974 server_base.cc:1034] running on GCE node
I20260807 18:43:35.742642 15974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:35.743255 15974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:35.744468 15974 hybrid_clock.cc:648] HybridClock initialized: now 1786128215744446 us; error 42 us; skew 500 ppm
I20260807 18:43:35.746173 15974 webserver.cc:460] Webserver started at http://127.10.174.194:42123/ using document root <none> and password file <none>
I20260807 18:43:35.746744 15974 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:35.746837 15974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:35.747067 15974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:35.749245 15974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "37a854b2747b411da86da10e37edc9d4"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "7926e3f43ceb2a13b7b1bebf4f2ca566"
server_key_iv: "331939b937672d44ce634862a17c99f7"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.749866 15974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "37a854b2747b411da86da10e37edc9d4"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "7926e3f43ceb2a13b7b1bebf4f2ca566"
server_key_iv: "331939b937672d44ce634862a17c99f7"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.753481 15974 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:43:35.756013 15990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.757203 15974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:35.757340 15974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "37a854b2747b411da86da10e37edc9d4"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "7926e3f43ceb2a13b7b1bebf4f2ca566"
server_key_iv: "331939b937672d44ce634862a17c99f7"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.757458 15974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:35.762104 15974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:35.762722 15974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:35.762908 15974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:35.763504 15974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:35.764396 15974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:35.764469 15974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.764539 15974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:35.764582 15974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.773607 15974 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:33489
I20260807 18:43:35.773627 16107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:33489 every 8 connection(s)
I20260807 18:43:35.774582 15974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:35.779376 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 15974
I20260807 18:43:35.779507 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:35.779856 10939 external_mini_cluster.cc:1428] Setting key 530cc9de16c100399d9b949565068f4c
I20260807 18:43:35.780941 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.776445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:40147 (local address 127.10.174.254:46627)
0807 18:43:35.776595 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.776600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.777691 (+ 1091us) server_negotiation.cc:407] Connection header received
0807 18:43:35.778917 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.778920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.778955 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.779030 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.780291 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.780295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.780299 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.780313 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.780337 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.780347 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.780444 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.780760 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.780808 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:43:35.781811 16110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.776913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:46627 (local address 127.10.174.194:40147)
0807 18:43:35.777548 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.777586 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.778734 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.779233 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.779243 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.779390 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:35.779985 (+ 595us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:35.779987 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:35.780037 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:35.780119 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:35.780585 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:35.780592 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:35.780596 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.780796 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.781033 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":120,"threads_started":1}
I20260807 18:43:35.781824 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:46627
--builtin_ntp_servers=127.10.174.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 18:43:35.782930 16108 heartbeater.cc:347] Connected to a master server at 127.10.174.254:46627
I20260807 18:43:35.783178 16108 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:35.783699 16108 heartbeater.cc:511] Master 127.10.174.254:46627 requested a full tablet report, sending...
I20260807 18:43:35.784762 15775 ts_manager.cc:194] Registered new tserver with Master: 37a854b2747b411da86da10e37edc9d4 (127.10.174.194:33489)
W20260807 18:43:35.890417 16111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:35.890669 16111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:35.890736 16111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:35.894860 16111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:35.894934 16111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:35.895021 16111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:35.899575 16111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:46627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:35.900553 16111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:35.901839 16111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:35.910760 16118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:35.910784 16120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:35.910854 16111 server_base.cc:1034] running on GCE node
W20260807 18:43:35.910760 16117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:35.911405 16111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:35.911981 16111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:35.913134 16111 hybrid_clock.cc:648] HybridClock initialized: now 1786128215913108 us; error 40 us; skew 500 ppm
I20260807 18:43:35.914798 16111 webserver.cc:460] Webserver started at http://127.10.174.195:37819/ using document root <none> and password file <none>
I20260807 18:43:35.915395 16111 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:35.915459 16111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:35.915670 16111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:35.917608 16111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "4084c6bd9eb5478b80d1bde5d519f285"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "9bd72a25912bb91156fab1a24dab171e"
server_key_iv: "5859b01ecfee6e0c6aff96bd593397ff"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.918164 16111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "4084c6bd9eb5478b80d1bde5d519f285"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "9bd72a25912bb91156fab1a24dab171e"
server_key_iv: "5859b01ecfee6e0c6aff96bd593397ff"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.921792 16111 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:35.924232 16126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.925420 16111 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:35.925536 16111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "4084c6bd9eb5478b80d1bde5d519f285"
format_stamp: "Formatted at 2026-08-07 18:43:35 on dist-test-slave-07c2"
server_key: "9bd72a25912bb91156fab1a24dab171e"
server_key_iv: "5859b01ecfee6e0c6aff96bd593397ff"
server_key_version: "encryptionkey@0"
I20260807 18:43:35.925639 16111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:35.930047 16111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:35.930608 16111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:35.930786 16111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:35.931362 16111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:35.932228 16111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:35.932276 16111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.932339 16111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:35.932375 16111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:35.940968 16111 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:34849
I20260807 18:43:35.940994 16243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:34849 every 8 connection(s)
I20260807 18:43:35.941798 16111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:35.947579 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.943635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:40697 (local address 127.10.174.254:46627)
0807 18:43:35.943776 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.943779 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.944814 (+ 1035us) server_negotiation.cc:407] Connection header received
0807 18:43:35.946026 (+ 1212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.946029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.946064 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.946136 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.947132 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.947135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.947137 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.947148 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.947175 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.947184 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.947257 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.947434 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.947474 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:43:35.948334 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16111
I20260807 18:43:35.948452 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:35.948449 16246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.944050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:46627 (local address 127.10.174.195:40697)
0807 18:43:35.944659 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.944697 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.945849 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.946291 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.946297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.946397 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:35.946890 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:35.946892 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:35.946929 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:35.946992 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:35.947258 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:35.947264 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:35.947268 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.947455 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.947662 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":111,"threads_started":1}
I20260807 18:43:35.948787 10939 external_mini_cluster.cc:1428] Setting key b1fd000fbb01933b7cd09b8867813d34
I20260807 18:43:35.949699 16244 heartbeater.cc:347] Connected to a master server at 127.10.174.254:46627
I20260807 18:43:35.949934 16244 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:35.950392 16244 heartbeater.cc:511] Master 127.10.174.254:46627 requested a full tablet report, sending...
I20260807 18:43:35.951416 15775 ts_manager.cc:194] Registered new tserver with Master: 4084c6bd9eb5478b80d1bde5d519f285 (127.10.174.195:34849)
I20260807 18:43:35.962642 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:43:35.966042 15816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.964577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45760 (local address 127.10.174.254:46627)
0807 18:43:35.964687 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.964690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.964925 (+ 235us) server_negotiation.cc:407] Connection header received
0807 18:43:35.965022 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.965025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.965057 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.965114 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.965744 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.965747 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.965749 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.965759 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.965775 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.965783 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.965849 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.965914 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.965945 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 18:43:35.968952 15775 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:35.971959 15775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:35.983013 16260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.980023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32864 (local address 127.10.174.194:33489)
0807 18:43:35.980998 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.981009 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.981032 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:43:35.981081 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.981085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.981269 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.981619 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.982447 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.982454 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.982469 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.982477 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.982506 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.982543 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.982642 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.982816 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.982886 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":122,"threads_started":1}
I20260807 18:43:35.982997 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.979860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:33489 (local address 127.0.0.1:32864)
0807 18:43:35.980650 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.980663 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.980747 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.981422 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.981426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.981443 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:35.981982 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:35.981987 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:35.981998 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:35.982021 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:35.982628 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:35.982637 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:35.982643 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.982800 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.982866 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":93,"threads_started":1}
I20260807 18:43:35.983201 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.979846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36584 (local address 127.10.174.195:34849)
0807 18:43:35.980506 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.980520 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.980788 (+ 268us) server_negotiation.cc:407] Connection header received
0807 18:43:35.980853 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.980860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.981055 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.981208 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.982368 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.982641 (+ 273us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.982652 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.982680 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.982722 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.982757 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.982868 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.982979 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.983048 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":115,"threads_started":1}
I20260807 18:43:35.983407 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.979748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:34849 (local address 127.0.0.1:36584)
0807 18:43:35.980510 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.980561 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.980669 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.981213 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.981219 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.981289 (+ 70us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:35.981847 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:35.981849 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:35.981870 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:35.981943 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:35.982842 (+ 899us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:35.982845 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:35.982849 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.982937 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.982975 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":74,"threads_started":1}
I20260807 18:43:35.984369 16261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.980656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:38073 (local address 127.0.0.1:42092)
0807 18:43:35.981483 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:35.981500 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:35.981578 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:35.982216 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:35.982219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:35.982232 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:35.983731 (+ 1499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:35.983733 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:35.983743 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:35.983779 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:35.984144 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:35.984148 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:35.984151 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 18:43:35.984224 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 18:43:35.984258 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"thread_start_us":94,"threads_started":1}
I20260807 18:43:35.984735 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:35.981076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42092 (local address 127.10.174.193:38073)
0807 18:43:35.981818 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:35.981830 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:35.981853 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:43:35.981909 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:35.981915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:35.982079 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:35.982225 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:35.983912 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:35.983918 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:35.983928 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:35.983940 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:35.983978 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:35.984006 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:35.984100 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:35.984533 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 18:43:35.984598 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":141,"threads_started":1}
I20260807 18:43:35.986044 16177 tablet_service.cc:1467] Processing CreateTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c (DEFAULT_TABLE table=test-table [id=adc490dd60c94a0da539b5e34f7fe95a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:35.986052 16041 tablet_service.cc:1467] Processing CreateTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c (DEFAULT_TABLE table=test-table [id=adc490dd60c94a0da539b5e34f7fe95a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:35.987092 16177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90bf1c326a044e13a4baeeb196fc5f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:35.987094 16041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90bf1c326a044e13a4baeeb196fc5f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:35.987183 15903 tablet_service.cc:1467] Processing CreateTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c (DEFAULT_TABLE table=test-table [id=adc490dd60c94a0da539b5e34f7fe95a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:35.988117 15903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90bf1c326a044e13a4baeeb196fc5f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:35.993444 16263 tablet_bootstrap.cc:492] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Bootstrap starting.
I20260807 18:43:35.994823 16265 tablet_bootstrap.cc:492] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Bootstrap starting.
I20260807 18:43:35.995040 16266 tablet_bootstrap.cc:492] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: Bootstrap starting.
I20260807 18:43:35.996716 16263 tablet_bootstrap.cc:654] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.996750 16265 tablet_bootstrap.cc:654] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.996995 16266 tablet_bootstrap.cc:654] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:35.997514 16265 log.cc:824] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.997598 16263 log.cc:824] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.997716 16266 log.cc:824] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:35.999526 16265 tablet_bootstrap.cc:492] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: No bootstrap required, opened a new log
I20260807 18:43:35.999526 16266 tablet_bootstrap.cc:492] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: No bootstrap required, opened a new log
I20260807 18:43:35.999711 16266 ts_tablet_manager.cc:1397] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:35.999711 16265 ts_tablet_manager.cc:1397] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:36.000416 16263 tablet_bootstrap.cc:492] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: No bootstrap required, opened a new log
I20260807 18:43:36.000609 16263 ts_tablet_manager.cc:1397] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:43:36.004123 16263 raft_consensus.cc:348] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.004364 16263 raft_consensus.cc:374] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:36.004227 16266 raft_consensus.cc:348] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.004227 16265 raft_consensus.cc:348] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.004418 16263 raft_consensus.cc:729] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4084c6bd9eb5478b80d1bde5d519f285, State: Initialized, Role: FOLLOWER
I20260807 18:43:36.004464 16265 raft_consensus.cc:374] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:36.004464 16266 raft_consensus.cc:374] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:36.004522 16265 raft_consensus.cc:729] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37a854b2747b411da86da10e37edc9d4, State: Initialized, Role: FOLLOWER
I20260807 18:43:36.004522 16266 raft_consensus.cc:729] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad14d3002a844a45a1c5785e6817af1a, State: Initialized, Role: FOLLOWER
I20260807 18:43:36.004906 16263 consensus_queue.cc:260] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.004938 16266 consensus_queue.cc:260] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.004938 16265 consensus_queue.cc:260] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.005556 16244 heartbeater.cc:503] Master 127.10.174.254:46627 was elected leader, sending a full tablet report...
I20260807 18:43:36.005887 16263 ts_tablet_manager.cc:1428] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:43:36.005884 16266 ts_tablet_manager.cc:1428] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:43:36.005884 16265 ts_tablet_manager.cc:1428] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:43:36.006184 15971 heartbeater.cc:503] Master 127.10.174.254:46627 was elected leader, sending a full tablet report...
I20260807 18:43:36.006981 16108 heartbeater.cc:503] Master 127.10.174.254:46627 was elected leader, sending a full tablet report...
W20260807 18:43:36.025724 16109 tablet.cc:2369] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:43:36.106285 15972 tablet.cc:2369] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:43:36.192772 16245 tablet.cc:2369] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:36.212772 16270 raft_consensus.cc:482] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:36.212976 16270 raft_consensus.cc:504] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.214061 16270 leader_election.cc:288] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37a854b2747b411da86da10e37edc9d4 (127.10.174.194:33489), ad14d3002a844a45a1c5785e6817af1a (127.10.174.193:38073)
I20260807 18:43:36.216056 16246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.214256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:33489 (local address 127.10.174.195:33513)
0807 18:43:36.214442 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:36.214459 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:36.214541 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:36.214852 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:36.214855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:36.214869 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:36.215420 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:36.215422 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:36.215431 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:36.215479 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:36.215776 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:36.215778 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:36.215780 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 18:43:36.215876 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 18:43:36.215918 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260807 18:43:36.216063 16260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.214395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:33513 (local address 127.10.174.194:33489)
0807 18:43:36.214525 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.214529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.214545 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:36.214695 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.214697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.214734 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.214803 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:36.215608 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:36.215611 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:36.215631 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:36.215646 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:36.215671 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:36.215683 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:36.215778 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:36.215887 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 18:43:36.215930 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:36.216065 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.214465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:39419 (local address 127.10.174.193:38073)
0807 18:43:36.214595 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.214599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.214859 (+ 260us) server_negotiation.cc:407] Connection header received
0807 18:43:36.214938 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.214940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.214971 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.215033 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:36.215703 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:36.215709 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:36.215715 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:36.215732 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:36.215753 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:36.215763 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:36.215850 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:36.215929 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 18:43:36.215964 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:43:36.216070 16273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.214367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:38073 (local address 127.10.174.195:39419)
0807 18:43:36.214739 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:36.214750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:36.214855 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:36.215079 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:36.215086 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:36.215098 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:36.215537 (+ 439us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:43:36.215540 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:36.215550 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:43:36.215575 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:36.215846 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:36.215851 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:36.215857 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:43:36.215928 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 18:43:36.215952 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":129,"threads_started":1}
I20260807 18:43:36.216728 16061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90bf1c326a044e13a4baeeb196fc5f8c" candidate_uuid: "4084c6bd9eb5478b80d1bde5d519f285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37a854b2747b411da86da10e37edc9d4" is_pre_election: true
I20260807 18:43:36.216809 15923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90bf1c326a044e13a4baeeb196fc5f8c" candidate_uuid: "4084c6bd9eb5478b80d1bde5d519f285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad14d3002a844a45a1c5785e6817af1a" is_pre_election: true
I20260807 18:43:36.217054 16061 raft_consensus.cc:2454] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4084c6bd9eb5478b80d1bde5d519f285 in term 0.
I20260807 18:43:36.217089 15923 raft_consensus.cc:2454] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4084c6bd9eb5478b80d1bde5d519f285 in term 0.
I20260807 18:43:36.217554 16127 leader_election.cc:302] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 37a854b2747b411da86da10e37edc9d4, 4084c6bd9eb5478b80d1bde5d519f285, ad14d3002a844a45a1c5785e6817af1a; no voters:
I20260807 18:43:36.217805 16270 raft_consensus.cc:2781] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:36.217887 16270 raft_consensus.cc:482] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:36.217931 16270 raft_consensus.cc:3037] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:36.218928 16270 raft_consensus.cc:504] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.219240 16270 leader_election.cc:288] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [CANDIDATE]: Term 1 election: Requested vote from peers 37a854b2747b411da86da10e37edc9d4 (127.10.174.194:33489), ad14d3002a844a45a1c5785e6817af1a (127.10.174.193:38073)
I20260807 18:43:36.219538 16061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90bf1c326a044e13a4baeeb196fc5f8c" candidate_uuid: "4084c6bd9eb5478b80d1bde5d519f285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37a854b2747b411da86da10e37edc9d4"
I20260807 18:43:36.219583 15923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90bf1c326a044e13a4baeeb196fc5f8c" candidate_uuid: "4084c6bd9eb5478b80d1bde5d519f285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad14d3002a844a45a1c5785e6817af1a"
I20260807 18:43:36.219682 16061 raft_consensus.cc:3037] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:36.219729 15923 raft_consensus.cc:3037] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:36.220683 15923 raft_consensus.cc:2454] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4084c6bd9eb5478b80d1bde5d519f285 in term 1.
I20260807 18:43:36.220698 16061 raft_consensus.cc:2454] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4084c6bd9eb5478b80d1bde5d519f285 in term 1.
I20260807 18:43:36.220976 16128 leader_election.cc:302] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37a854b2747b411da86da10e37edc9d4, 4084c6bd9eb5478b80d1bde5d519f285; no voters:
I20260807 18:43:36.221174 16270 raft_consensus.cc:2781] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:36.221367 16270 raft_consensus.cc:686] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 1 LEADER]: Becoming Leader. State: Replica: 4084c6bd9eb5478b80d1bde5d519f285, State: Running, Role: LEADER
I20260807 18:43:36.221683 16270 consensus_queue.cc:237] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } }
I20260807 18:43:36.224776 15774 catalog_manager.cc:5495] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4084c6bd9eb5478b80d1bde5d519f285 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "4084c6bd9eb5478b80d1bde5d519f285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4084c6bd9eb5478b80d1bde5d519f285" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 34849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:36.272575 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.270936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36596 (local address 127.10.174.195:34849)
0807 18:43:36.271082 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.271087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.271104 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:43:36.271208 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.271211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.271268 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.271413 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:36.272170 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:36.272173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:36.272176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:36.272188 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:36.272213 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:36.272223 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:36.272314 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:36.272387 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 18:43:36.272427 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:36.278532 16061 raft_consensus.cc:1261] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 1 FOLLOWER]: Refusing update from remote peer 4084c6bd9eb5478b80d1bde5d519f285: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:36.278532 15923 raft_consensus.cc:1261] T 90bf1c326a044e13a4baeeb196fc5f8c P ad14d3002a844a45a1c5785e6817af1a [term 1 FOLLOWER]: Refusing update from remote peer 4084c6bd9eb5478b80d1bde5d519f285: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:36.279237 16270 consensus_queue.cc:1035] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad14d3002a844a45a1c5785e6817af1a" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 38073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:36.279495 16274 consensus_queue.cc:1035] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37a854b2747b411da86da10e37edc9d4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:36.285050 16277 mvcc.cc:205] Tried to move back new op lower bound from 7315981173870215168 to 7315981173646503936. Current Snapshot: MvccSnapshot[applied={T|T < 7315981173870215168}]
I20260807 18:43:36.293392 15774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:36.293551 15774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:36.296077 15774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e225fae0c17740aca70dc8d038981dc5: Sending DeleteTablet for 3 replicas of tablet 90bf1c326a044e13a4baeeb196fc5f8c
I20260807 18:43:36.296852 16041 tablet_service.cc:1514] Processing DeleteTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:36 UTC) from {username='slave'} at 127.0.0.1:32864
I20260807 18:43:36.296875 16177 tablet_service.cc:1514] Processing DeleteTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:36 UTC) from {username='slave'} at 127.0.0.1:36584
I20260807 18:43:36.297072 15903 tablet_service.cc:1514] Processing DeleteTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:36 UTC) from {username='slave'} at 127.0.0.1:42092
I20260807 18:43:36.297303 16290 tablet_replica.cc:330] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: stopping tablet replica
I20260807 18:43:36.297421 15902 tablet_service.cc:1514] Processing DeleteTablet for tablet 90bf1c326a044e13a4baeeb196fc5f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:36 UTC) from {username='slave'} at 127.0.0.1:42092
I20260807 18:43:36.297590 16290 raft_consensus.cc:2229] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:36.297803 16289 tablet_replica.cc:330] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: stopping tablet replica
I20260807 18:43:36.297887 16290 raft_consensus.cc:2258] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:36.298054 16289 raft_consensus.cc:2229] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:36.298189 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15837
I20260807 18:43:36.298369 16289 raft_consensus.cc:2258] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:36.299316 16290 ts_tablet_manager.cc:1905] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:36.299988 16289 ts_tablet_manager.cc:1905] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:36.302060 16290 ts_tablet_manager.cc:1918] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:36.302145 16290 log.cc:1196] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/90bf1c326a044e13a4baeeb196fc5f8c
I20260807 18:43:36.302467 16290 ts_tablet_manager.cc:1939] T 90bf1c326a044e13a4baeeb196fc5f8c P 37a854b2747b411da86da10e37edc9d4: Deleting consensus metadata
I20260807 18:43:36.302714 16289 ts_tablet_manager.cc:1918] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:36.302793 16289 log.cc:1196] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/90bf1c326a044e13a4baeeb196fc5f8c
I20260807 18:43:36.303102 16289 ts_tablet_manager.cc:1939] T 90bf1c326a044e13a4baeeb196fc5f8c P 4084c6bd9eb5478b80d1bde5d519f285: Deleting consensus metadata
I20260807 18:43:36.303721 15759 catalog_manager.cc:4841] TS 37a854b2747b411da86da10e37edc9d4 (127.10.174.194:33489): tablet 90bf1c326a044e13a4baeeb196fc5f8c (table test-table [id=adc490dd60c94a0da539b5e34f7fe95a]) successfully deleted
I20260807 18:43:36.304147 15758 catalog_manager.cc:4841] TS 4084c6bd9eb5478b80d1bde5d519f285 (127.10.174.195:34849): tablet 90bf1c326a044e13a4baeeb196fc5f8c (table test-table [id=adc490dd60c94a0da539b5e34f7fe95a]) successfully deleted
W20260807 18:43:36.308296 15758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:38073 (error 108)
I20260807 18:43:36.309170 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15974
I20260807 18:43:36.309193 16261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.308945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:38073 (local address 127.0.0.1:42094)
0807 18:43:36.309069 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:36.309129 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:38073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 18:43:36.315364 15758 catalog_manager.cc:4584] TS ad14d3002a844a45a1c5785e6817af1a (127.10.174.193:38073): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 90bf1c326a044e13a4baeeb196fc5f8c: Network error: Client connection negotiation failed: client connection to 127.10.174.193:38073: connect: Connection refused (error 111)
I20260807 18:43:36.317926 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16111
I20260807 18:43:36.323873 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 15742
2026-08-07T18:43:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1159 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 18:43:36.345903 10939 mini_oidc.cc:152] Starting JWKS server
I20260807 18:43:36.347733 10939 webserver.cc:460] Webserver started at https://127.0.0.1:40707/ using document root <none> and password file <none>
I20260807 18:43:36.347911 10939 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 18:43:36.348188 10939 webserver.cc:460] Webserver started at http://127.0.0.1:35735/ using document root <none> and password file <none>
2026-08-07T18:43:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:36Z Disabled control of system clock
I20260807 18:43:36.358101 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36739
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:44817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:36739
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40707/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/testchainca.cert with env {}
W20260807 18:43:36.468153 16298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:36.468407 16298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:36.468446 16298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:36.472325 16298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:36.472370 16298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:36.472386 16298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:36.472402 16298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:36.472417 16298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:43:36.472433 16298 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 18:43:36.472446 16298 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40707/jwks.json
I20260807 18:43:36.477607 16298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:36739
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40707/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:36.478544 16298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:36.479475 16298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:43:36.487716 16298 server_base.cc:1034] running on GCE node
W20260807 18:43:36.487628 16305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:36.487598 16307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:36.487601 16304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:36.488436 16298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:36.489485 16298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:36.490670 16298 hybrid_clock.cc:648] HybridClock initialized: now 1786128216490640 us; error 43 us; skew 500 ppm
I20260807 18:43:36.492519 16298 webserver.cc:460] Webserver started at http://127.10.174.254:44263/ using document root <none> and password file <none>
I20260807 18:43:36.493080 16298 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:36.493180 16298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:36.493422 16298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:36.495523 16298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "786e87d78d9e4af88e6cd6355aa5d1d9"
format_stamp: "Formatted at 2026-08-07 18:43:36 on dist-test-slave-07c2"
server_key: "3a3ee71a31ed08e035effcf87c20e8aa"
server_key_iv: "03f4297a3574c891d898d2ae01e2fc22"
server_key_version: "encryptionkey@0"
I20260807 18:43:36.496131 16298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "786e87d78d9e4af88e6cd6355aa5d1d9"
format_stamp: "Formatted at 2026-08-07 18:43:36 on dist-test-slave-07c2"
server_key: "3a3ee71a31ed08e035effcf87c20e8aa"
server_key_iv: "03f4297a3574c891d898d2ae01e2fc22"
server_key_version: "encryptionkey@0"
I20260807 18:43:36.499734 16298 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:43:36.501948 16314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:36.503086 16298 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:36.503235 16298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "786e87d78d9e4af88e6cd6355aa5d1d9"
format_stamp: "Formatted at 2026-08-07 18:43:36 on dist-test-slave-07c2"
server_key: "3a3ee71a31ed08e035effcf87c20e8aa"
server_key_iv: "03f4297a3574c891d898d2ae01e2fc22"
server_key_version: "encryptionkey@0"
I20260807 18:43:36.503392 16298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:36.519883 16298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:36.520539 16298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:36.520752 16298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:36.527639 16298 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:36739
I20260807 18:43:36.527679 16367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:36739 every 8 connection(s)
I20260807 18:43:36.528609 16298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:36.531740 16368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:36.534196 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16298
I20260807 18:43:36.534317 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:36.534639 10939 external_mini_cluster.cc:1428] Setting key 1014cd301bc722ca1fc5d6d2560ac280
I20260807 18:43:36.537745 16368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9: Bootstrap starting.
I20260807 18:43:36.540031 16368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:36.540802 16368 log.cc:824] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:36.543198 16368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9: No bootstrap required, opened a new log
I20260807 18:43:36.543958 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.536065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47340 (local address 127.10.174.254:36739)
0807 18:43:36.536739 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.536754 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.536794 (+ 40us) server_negotiation.cc:407] Connection header received
0807 18:43:36.537403 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.537418 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.537798 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.538152 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:36.538578 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.539588 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.540559 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.541071 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.541237 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:36.542160 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:36.542166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:36.542177 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:36.542556 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:36.542609 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:36.542628 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:36.542710 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:36.542890 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 18:43:36.543180 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":135,"threads_started":1}
I20260807 18:43:36.547948 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:43:36.547782 16368 raft_consensus.cc:348] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36739 } }
I20260807 18:43:36.548051 16368 raft_consensus.cc:374] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:36.548107 16368 raft_consensus.cc:729] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786e87d78d9e4af88e6cd6355aa5d1d9, State: Initialized, Role: FOLLOWER
I20260807 18:43:36.548586 16368 consensus_queue.cc:260] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36739 } }
I20260807 18:43:36.548764 16368 raft_consensus.cc:388] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:36.548836 16368 raft_consensus.cc:482] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:36.548945 16368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:36.550017 16368 raft_consensus.cc:504] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36739 } }
I20260807 18:43:36.550355 16368 leader_election.cc:302] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 786e87d78d9e4af88e6cd6355aa5d1d9; no voters:
I20260807 18:43:36.550688 16368 leader_election.cc:288] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:36.550805 16373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:36.551057 16373 raft_consensus.cc:686] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [term 1 LEADER]: Becoming Leader. State: Replica: 786e87d78d9e4af88e6cd6355aa5d1d9, State: Running, Role: LEADER
I20260807 18:43:36.551534 16373 consensus_queue.cc:237] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36739 } }
I20260807 18:43:36.552053 16368 sys_catalog.cc:564] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:36.553258 16374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36739 } } }
I20260807 18:43:36.553439 16374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:36.553273 16375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 786e87d78d9e4af88e6cd6355aa5d1d9. Latest consensus state: current_term: 1 leader_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786e87d78d9e4af88e6cd6355aa5d1d9" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36739 } } }
I20260807 18:43:36.553675 16375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:36.554371 16383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:36.557417 16383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:36.563073 16383 catalog_manager.cc:1347] Generated new cluster ID: 9904c67dd5f647368aab87ff0f33c2b6
I20260807 18:43:36.563156 16383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:36.597136 16383 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:36.598078 16383 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:36.607357 16383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 786e87d78d9e4af88e6cd6355aa5d1d9: Generated new TSK 0
I20260807 18:43:36.608039 16383 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 18:43:36.640031 16401 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 18:43:36.640213 16401 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 18:43:36.640666 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.623193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.10.174.254:36739)
0807 18:43:36.623359 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.623364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.623550 (+ 186us) server_negotiation.cc:407] Connection header received
0807 18:43:36.623753 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.623755 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.623799 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.623882 (+ 83us) server_negotiation.cc:226] Negotiated authn=JWT
0807 18:43:36.624165 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.624691 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.625940 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.626175 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.626265 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:36.626623 (+ 358us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 18:43:36.640352 (+ 13729us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 18:43:36.640564 (+ 212us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47352: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 18:43:36.640748 16371 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47352: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 18:43:36.642202 16400 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:36.623092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36739 (local address 127.0.0.1:47352)
0807 18:43:36.623464 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:36.623479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:36.623607 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:36.623922 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:36.623925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:36.623934 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 18:43:36.624048 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:36.624055 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.624818 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.624822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:36.625813 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:36.625823 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.626296 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.626300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:36.626392 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:36.626440 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 18:43:36.640557 (+ 14117us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 18:43:36.640775 (+ 218us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.174.254:36739: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":119,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.174.254:36739: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40707/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 18:43:36.642958 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16298
2026-08-07T18:43:36Z chronyd exiting
I20260807 18:43:36.681917 10939 test_util.cc:175] -----------------------------------------------
I20260807 18:43:36.682000 10939 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786128190976416-10939-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (337 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 18:43:36.683125 10939 mini_oidc.cc:152] Starting JWKS server
I20260807 18:43:36.684049 10939 webserver.cc:460] Webserver started at https://127.0.0.1:39291/ using document root <none> and password file <none>
I20260807 18:43:36.684170 10939 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 18:43:36.684446 10939 webserver.cc:460] Webserver started at http://127.0.0.1:37785/ using document root <none> and password file <none>
2026-08-07T18:43:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:36Z Disabled control of system clock
I20260807 18:43:36.694170 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:44639
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:44639
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39291/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/testchainca.cert with env {}
W20260807 18:43:36.802289 16407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:36.802516 16407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:36.802553 16407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:36.806474 16407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:36.806524 16407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:36.806540 16407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:36.806556 16407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:36.806574 16407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:43:36.806591 16407 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 18:43:36.806603 16407 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39291/jwks.json
I20260807 18:43:36.811812 16407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:44639
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:44639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39291/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:36.812669 16407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:36.813537 16407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:36.821409 16418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:36.821441 16414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:36.821441 16412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:36.821620 16407 server_base.cc:1034] running on GCE node
I20260807 18:43:36.822155 16407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:36.823163 16407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:36.824347 16407 hybrid_clock.cc:648] HybridClock initialized: now 1786128216824318 us; error 41 us; skew 500 ppm
I20260807 18:43:36.826051 16407 webserver.cc:460] Webserver started at http://127.10.174.254:38087/ using document root <none> and password file <none>
I20260807 18:43:36.826603 16407 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:36.826694 16407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:36.826916 16407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:36.828974 16407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "c0c03e56ca2347a2bd0761acd2c600f7"
format_stamp: "Formatted at 2026-08-07 18:43:36 on dist-test-slave-07c2"
server_key: "82111aaedc07351ed6e0ced8212be19d"
server_key_iv: "8a6a48174012dbcce656634386e1bdcd"
server_key_version: "encryptionkey@0"
I20260807 18:43:36.829581 16407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "c0c03e56ca2347a2bd0761acd2c600f7"
format_stamp: "Formatted at 2026-08-07 18:43:36 on dist-test-slave-07c2"
server_key: "82111aaedc07351ed6e0ced8212be19d"
server_key_iv: "8a6a48174012dbcce656634386e1bdcd"
server_key_version: "encryptionkey@0"
I20260807 18:43:36.833124 16407 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 18:43:36.835422 16427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:36.836566 16407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:43:36.836699 16407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "c0c03e56ca2347a2bd0761acd2c600f7"
format_stamp: "Formatted at 2026-08-07 18:43:36 on dist-test-slave-07c2"
server_key: "82111aaedc07351ed6e0ced8212be19d"
server_key_iv: "8a6a48174012dbcce656634386e1bdcd"
server_key_version: "encryptionkey@0"
I20260807 18:43:36.836812 16407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:36.847749 16407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:36.848407 16407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:36.848611 16407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:36.855518 16407 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:44639
I20260807 18:43:36.855597 16480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:44639 every 8 connection(s)
I20260807 18:43:36.856442 16407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:36.859472 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16407
I20260807 18:43:36.859570 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:36.859668 16481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:36.859929 10939 external_mini_cluster.cc:1428] Setting key a83b3084f62d1f34fccae4f20b01cbb7
I20260807 18:43:36.866590 16481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7: Bootstrap starting.
I20260807 18:43:36.869072 16481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:36.869799 16484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.861310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59212 (local address 127.10.174.254:44639)
0807 18:43:36.862089 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.862111 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.862154 (+ 43us) server_negotiation.cc:407] Connection header received
0807 18:43:36.863442 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.863461 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.863854 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.864184 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:36.864604 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.865543 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.866468 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.866986 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.867155 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:36.868108 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:36.868113 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:36.868125 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:36.868504 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:36.868575 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:36.868594 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:36.868705 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:36.868829 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 18:43:36.869080 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":170,"threads_started":1}
I20260807 18:43:36.869820 16481 log.cc:824] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:36.872015 16481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7: No bootstrap required, opened a new log
I20260807 18:43:36.872529 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:43:36.875984 16481 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44639 } }
I20260807 18:43:36.876256 16481 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:36.876334 16481 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c03e56ca2347a2bd0761acd2c600f7, State: Initialized, Role: FOLLOWER
I20260807 18:43:36.876746 16481 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44639 } }
I20260807 18:43:36.876895 16481 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:36.876981 16481 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:36.877099 16481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:36.878006 16481 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44639 } }
I20260807 18:43:36.878353 16481 leader_election.cc:302] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0c03e56ca2347a2bd0761acd2c600f7; no voters:
I20260807 18:43:36.878674 16481 leader_election.cc:288] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:36.878809 16486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:36.879040 16486 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [term 1 LEADER]: Becoming Leader. State: Replica: c0c03e56ca2347a2bd0761acd2c600f7, State: Running, Role: LEADER
I20260807 18:43:36.879374 16486 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44639 } }
I20260807 18:43:36.879953 16481 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:36.880898 16487 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44639 } } }
I20260807 18:43:36.881036 16487 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:36.881356 16488 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0c03e56ca2347a2bd0761acd2c600f7. Latest consensus state: current_term: 1 leader_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0c03e56ca2347a2bd0761acd2c600f7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44639 } } }
I20260807 18:43:36.881415 16496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:36.881448 16488 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:36.884539 16496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:36.890179 16496 catalog_manager.cc:1347] Generated new cluster ID: 3c2160e0c6f24e29884e47169690e366
I20260807 18:43:36.890264 16496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:36.907401 16496 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:36.908317 16496 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:36.917894 16496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0c03e56ca2347a2bd0761acd2c600f7: Generated new TSK 0
I20260807 18:43:36.918551 16496 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 18:43:36.947026 16512 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 18:43:36.947118 16512 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 18:43:36.947805 16484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:36.932009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59216 (local address 127.10.174.254:44639)
0807 18:43:36.932153 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:36.932157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:36.932369 (+ 212us) server_negotiation.cc:407] Connection header received
0807 18:43:36.932528 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:36.932530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:36.932574 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:36.932667 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0807 18:43:36.932918 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.933441 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.934661 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.934870 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.934938 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:36.935265 (+ 327us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 18:43:36.947468 (+ 12203us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39291/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 18:43:36.947686 (+ 218us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59216: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39291/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 18:43:36.947889 16484 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59216: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39291/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 18:43:36.948032 16511 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:36.931948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:44639 (local address 127.0.0.1:59216)
0807 18:43:36.932269 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:36.932285 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:36.932404 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:36.932690 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:36.932694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:36.932702 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 18:43:36.932814 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:36.932820 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.933552 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.933557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:36.934533 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:36.934543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:36.934979 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:36.934983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:36.935074 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:36.935103 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 18:43:36.947656 (+ 12553us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39291/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 18:43:36.947850 (+ 194us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.174.254:44639: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39291/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":124,"threads_started":1}
I20260807 18:43:36.948621 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16407
2026-08-07T18:43:36Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (306 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 18:43:36.989892 10939 mini_oidc.cc:152] Starting JWKS server
I20260807 18:43:36.990770 10939 webserver.cc:460] Webserver started at https://127.0.0.1:45723/ using document root <none> and password file <none>
I20260807 18:43:36.990886 10939 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 18:43:36.991197 10939 webserver.cc:460] Webserver started at http://127.0.0.1:34893/ using document root <none> and password file <none>
2026-08-07T18:43:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:36Z Disabled control of system clock
I20260807 18:43:37.000881 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42859
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:44969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:42859
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45723/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 18:43:37.109817 16518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:37.110086 16518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:37.110126 16518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:37.114046 16518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:37.114107 16518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:37.114122 16518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:37.114140 16518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:37.114154 16518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:43:37.114169 16518 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 18:43:37.114182 16518 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45723/jwks.json
I20260807 18:43:37.118933 16518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:42859
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45723/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:37.119987 16518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:37.121301 16518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:37.129530 16524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:37.129544 16526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:37.129570 16523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:37.130034 16518 server_base.cc:1034] running on GCE node
I20260807 18:43:37.130604 16518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:37.131718 16518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:37.132910 16518 hybrid_clock.cc:648] HybridClock initialized: now 1786128217132892 us; error 30 us; skew 500 ppm
I20260807 18:43:37.139351 16518 webserver.cc:460] Webserver started at http://127.10.174.254:43785/ using document root <none> and password file <none>
I20260807 18:43:37.139951 16518 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:37.140051 16518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:37.140296 16518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:37.142422 16518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "9f982e42ba3848ed9407f63d7a5ff89f"
format_stamp: "Formatted at 2026-08-07 18:43:37 on dist-test-slave-07c2"
server_key: "64f06ae1a475be9bf8e260aa0f6dd1c6"
server_key_iv: "2a91f3ecdf2aad05b528882b7f4ec012"
server_key_version: "encryptionkey@0"
I20260807 18:43:37.143038 16518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "9f982e42ba3848ed9407f63d7a5ff89f"
format_stamp: "Formatted at 2026-08-07 18:43:37 on dist-test-slave-07c2"
server_key: "64f06ae1a475be9bf8e260aa0f6dd1c6"
server_key_iv: "2a91f3ecdf2aad05b528882b7f4ec012"
server_key_version: "encryptionkey@0"
I20260807 18:43:37.146878 16518 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 18:43:37.149295 16533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:37.150478 16518 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:37.150620 16518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "9f982e42ba3848ed9407f63d7a5ff89f"
format_stamp: "Formatted at 2026-08-07 18:43:37 on dist-test-slave-07c2"
server_key: "64f06ae1a475be9bf8e260aa0f6dd1c6"
server_key_iv: "2a91f3ecdf2aad05b528882b7f4ec012"
server_key_version: "encryptionkey@0"
I20260807 18:43:37.150733 16518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:37.172619 16518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:37.173342 16518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:37.173547 16518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:37.180408 16518 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:42859
I20260807 18:43:37.180418 16589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:42859 every 8 connection(s)
I20260807 18:43:37.181358 16518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:37.184399 16590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:37.186890 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16518
I20260807 18:43:37.187026 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:37.187374 10939 external_mini_cluster.cc:1428] Setting key 4eda40cb8e5f94b1d2c84a802547fbec
I20260807 18:43:37.190328 16590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f: Bootstrap starting.
I20260807 18:43:37.192633 16590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:37.193364 16590 log.cc:824] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:37.195358 16590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f: No bootstrap required, opened a new log
I20260807 18:43:37.196626 16593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:37.188776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60332 (local address 127.10.174.254:42859)
0807 18:43:37.189403 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:37.189418 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:37.189452 (+ 34us) server_negotiation.cc:407] Connection header received
0807 18:43:37.190056 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:37.190072 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:37.190508 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:37.190835 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:37.191273 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.192374 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.193332 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.193851 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.194021 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:37.194897 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:37.194902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:37.194914 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:37.195340 (+ 426us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:37.195403 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:37.195423 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:37.195533 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:37.195720 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 18:43:37.195964 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":117,"threads_started":1}
I20260807 18:43:37.199355 16590 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42859 } }
I20260807 18:43:37.199536 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:43:37.199615 16590 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:37.199688 16590 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f982e42ba3848ed9407f63d7a5ff89f, State: Initialized, Role: FOLLOWER
I20260807 18:43:37.200119 16590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42859 } }
I20260807 18:43:37.200271 16590 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:37.200337 16590 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:37.200431 16590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:37.201500 16590 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42859 } }
I20260807 18:43:37.201836 16590 leader_election.cc:302] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f982e42ba3848ed9407f63d7a5ff89f; no voters:
I20260807 18:43:37.202152 16590 leader_election.cc:288] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:37.202333 16595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:37.202601 16595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [term 1 LEADER]: Becoming Leader. State: Replica: 9f982e42ba3848ed9407f63d7a5ff89f, State: Running, Role: LEADER
I20260807 18:43:37.202901 16595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42859 } }
I20260807 18:43:37.203431 16590 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:37.204555 16597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f982e42ba3848ed9407f63d7a5ff89f. Latest consensus state: current_term: 1 leader_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42859 } } }
I20260807 18:43:37.204684 16597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:37.204962 16596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f982e42ba3848ed9407f63d7a5ff89f" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42859 } } }
I20260807 18:43:37.205051 16604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:37.205080 16596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:37.208143 16604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:37.213137 16604 catalog_manager.cc:1347] Generated new cluster ID: 78d0dd0337d44e03aa8bddc88aa80403
I20260807 18:43:37.213210 16604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:37.221175 16604 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:37.221997 16604 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:37.226358 16604 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f982e42ba3848ed9407f63d7a5ff89f: Generated new TSK 0
I20260807 18:43:37.227018 16604 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:43:37.246824 16593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:37.241901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60338 (local address 127.10.174.254:42859)
0807 18:43:37.242048 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:37.242055 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:37.242207 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:43:37.242357 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:37.242359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:37.242403 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:37.242487 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0807 18:43:37.242742 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.243258 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.244523 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.244752 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.244833 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:37.245163 (+ 330us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 18:43:37.246467 (+ 1304us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45723/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 18:43:37.246693 (+ 226us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60338: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45723/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 18:43:37.246886 16593 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60338: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45723/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 18:43:37.248775 16619 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:37.241827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42859 (local address 127.0.0.1:60338)
0807 18:43:37.242116 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:37.242131 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:37.242244 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:37.242514 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:37.242518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:37.242526 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 18:43:37.242641 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:37.242647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.243412 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.243416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:37.244398 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:37.244408 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.244881 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.244885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:37.244976 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:37.245004 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 18:43:37.246631 (+ 1627us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45723/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 18:43:37.248593 (+ 1962us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.174.254:42859: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45723/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":1769,"thread_start_us":104,"threads_started":1}
I20260807 18:43:37.249444 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16518
E20260807 18:43:37.257164 16620 webserver.cc:533] Webserver: sslize failed:
E20260807 18:43:37.257246 16620 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T18:43:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (299 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T18:43:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:37Z Disabled control of system clock
I20260807 18:43:37.298604 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38087
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:34755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38087
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/testchainca.cert with env {}
W20260807 18:43:37.406270 16624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:37.406515 16624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:37.406560 16624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:37.410406 16624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:37.410454 16624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:37.410470 16624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:37.410485 16624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:37.410499 16624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 18:43:37.410516 16624 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 18:43:37.410535 16624 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 18:43:37.415727 16624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:34755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38087
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:37.416608 16624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:37.417479 16624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:37.425668 16629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:37.425670 16630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:37.425768 16632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:37.425806 16624 server_base.cc:1034] running on GCE node
I20260807 18:43:37.426441 16624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:37.427558 16624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:37.428769 16624 hybrid_clock.cc:648] HybridClock initialized: now 1786128217428737 us; error 43 us; skew 500 ppm
I20260807 18:43:37.430629 16624 webserver.cc:460] Webserver started at http://127.10.174.254:39079/ using document root <none> and password file <none>
I20260807 18:43:37.431177 16624 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:37.431315 16624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:37.431538 16624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:37.433573 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "0d5f47ddd17946e0ad22a1529ab0d89a"
format_stamp: "Formatted at 2026-08-07 18:43:37 on dist-test-slave-07c2"
server_key: "c8ff40fb95c7ff4ae7ac0c93a235479d"
server_key_iv: "4f5d0d2fbe121b6449133777eb732d42"
server_key_version: "encryptionkey@0"
I20260807 18:43:37.434168 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "0d5f47ddd17946e0ad22a1529ab0d89a"
format_stamp: "Formatted at 2026-08-07 18:43:37 on dist-test-slave-07c2"
server_key: "c8ff40fb95c7ff4ae7ac0c93a235479d"
server_key_iv: "4f5d0d2fbe121b6449133777eb732d42"
server_key_version: "encryptionkey@0"
I20260807 18:43:37.437749 16624 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:37.440019 16639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:37.441129 16624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:37.441269 16624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "0d5f47ddd17946e0ad22a1529ab0d89a"
format_stamp: "Formatted at 2026-08-07 18:43:37 on dist-test-slave-07c2"
server_key: "c8ff40fb95c7ff4ae7ac0c93a235479d"
server_key_iv: "4f5d0d2fbe121b6449133777eb732d42"
server_key_version: "encryptionkey@0"
I20260807 18:43:37.441380 16624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:37.456024 16624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:37.456637 16624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:37.456825 16624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:37.463464 16624 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38087
I20260807 18:43:37.463503 16694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38087 every 8 connection(s)
I20260807 18:43:37.464357 16624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:37.466969 16695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:37.472096 16695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a: Bootstrap starting.
I20260807 18:43:37.474282 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16624
I20260807 18:43:37.474418 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:37.474562 16695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:37.474787 10939 external_mini_cluster.cc:1428] Setting key e2d56ad1bfedd560cd8626b9881f6db7
I20260807 18:43:37.475461 16695 log.cc:824] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:37.477344 16695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a: No bootstrap required, opened a new log
I20260807 18:43:37.480674 16695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38087 } }
I20260807 18:43:37.480906 16695 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:37.480959 16695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5f47ddd17946e0ad22a1529ab0d89a, State: Initialized, Role: FOLLOWER
I20260807 18:43:37.481411 16695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38087 } }
I20260807 18:43:37.481542 16695 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:37.481653 16695 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:37.481770 16695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:37.482728 16695 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38087 } }
I20260807 18:43:37.483062 16695 leader_election.cc:302] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d5f47ddd17946e0ad22a1529ab0d89a; no voters:
I20260807 18:43:37.483387 16695 leader_election.cc:288] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:37.483410 16699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:37.475834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.10.174.254:38087)
0807 18:43:37.476385 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:37.476399 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:37.476431 (+ 32us) server_negotiation.cc:407] Connection header received
0807 18:43:37.476997 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:37.477012 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:37.477304 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:37.477656 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:37.478056 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.478992 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.479978 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.480419 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.480590 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:37.481460 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:37.481464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:37.481475 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:43:37.481988 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:37.482041 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:43:37.482061 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:37.482163 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:37.482285 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 18:43:37.482526 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":94,"threads_started":1}
I20260807 18:43:37.483487 16700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:37.483686 16700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [term 1 LEADER]: Becoming Leader. State: Replica: 0d5f47ddd17946e0ad22a1529ab0d89a, State: Running, Role: LEADER
I20260807 18:43:37.483973 16700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38087 } }
I20260807 18:43:37.484616 16695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:37.485219 16702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d5f47ddd17946e0ad22a1529ab0d89a. Latest consensus state: current_term: 1 leader_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38087 } } }
I20260807 18:43:37.485342 16702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:37.485671 16701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d5f47ddd17946e0ad22a1529ab0d89a" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38087 } } }
I20260807 18:43:37.485777 16701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:37.486356 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 18:43:37.489178 16715 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:37.489243 16715 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:37.489329 16707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:37.489991 16707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:37.495461 16707 catalog_manager.cc:1347] Generated new cluster ID: 7de7923d5ee24bf0b87f8f9bbb80ffc1
I20260807 18:43:37.495519 16707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:37.527926 16707 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:37.528908 16707 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:37.535821 16707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d5f47ddd17946e0ad22a1529ab0d89a: Generated new TSK 0
I20260807 18:43:37.536720 16707 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:43:37.639830 16699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:37.557454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40350 (local address 127.10.174.254:38087)
0807 18:43:37.557602 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:37.557607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:37.557800 (+ 193us) server_negotiation.cc:407] Connection header received
0807 18:43:37.557944 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:37.557946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:37.557991 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:37.558078 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0807 18:43:37.558338 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.558863 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.560108 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.560329 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.560407 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:37.560749 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 18:43:37.639451 (+ 78702us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 18:43:37.639712 (+ 261us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40350: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 18:43:37.639930 16699 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40350: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 18:43:37.640110 16725 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:37.557396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38087 (local address 127.0.0.1:40350)
0807 18:43:37.557706 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:37.557721 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:37.557836 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:37.558105 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:37.558108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:37.558116 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 18:43:37.558232 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:37.558239 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.558988 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.558993 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:37.559998 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:37.560008 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:37.560450 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:37.560454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:37.560557 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:37.560586 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 18:43:37.639695 (+ 79109us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 18:43:37.639912 (+ 217us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.174.254:38087: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":119,"threads_started":1}
I20260807 18:43:37.640798 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16624
2026-08-07T18:43:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (372 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (121 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (119 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:37 dist-test-slave-07c2 krb5kdc[16737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:37 dist-test-slave-07c2 krb5kdc[16737](info): set up 2 sockets
Aug 07 18:43:37 dist-test-slave-07c2 krb5kdc[16737](info): commencing operation
krb5kdc: starting...
W20260807 18:43:38.926465 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:39.044103 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43909
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43909
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:39.149577 16750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:39.149811 16750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:39.149888 16750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:39.153790 16750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:39.153838 16750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:39.153857 16750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:39.153918 16750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:39.153952 16750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:39.159001 16750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:39.159919 16750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:39.161154 16750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:39.168963 16756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:39.169000 16758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:39.169102 16750 server_base.cc:1034] running on GCE node
W20260807 18:43:39.168982 16755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:39.169790 16750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:39.170749 16750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:39.171909 16750 hybrid_clock.cc:648] HybridClock initialized: now 1786128219171891 us; error 29 us; skew 500 ppm
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.174556 16750 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:39.175410 16750 webserver.cc:460] Webserver started at http://127.10.174.254:39791/ using document root <none> and password file <none>
I20260807 18:43:39.175925 16750 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:39.176011 16750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:39.176244 16750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:39.178133 16750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "4cb3101d8a6f4413b7ad1381ce14c19c"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "9c3cfd3741373afbe82a345b4ff2e998"
server_key_iv: "2f110d0c86350d74174c9a5ff0ce4145"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.178759 16750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "4cb3101d8a6f4413b7ad1381ce14c19c"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "9c3cfd3741373afbe82a345b4ff2e998"
server_key_iv: "2f110d0c86350d74174c9a5ff0ce4145"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.182318 16750 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 18:43:39.184612 16765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.185721 16750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:39.185861 16750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "4cb3101d8a6f4413b7ad1381ce14c19c"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "9c3cfd3741373afbe82a345b4ff2e998"
server_key_iv: "2f110d0c86350d74174c9a5ff0ce4145"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.185968 16750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:39.213318 16750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:39.216701 16750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:39.216920 16750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:39.223716 16750 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:43909
I20260807 18:43:39.223740 16818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:43909 every 8 connection(s)
I20260807 18:43:39.224617 16750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:39.227239 16819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:39.229537 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16750
I20260807 18:43:39.229636 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:39.229919 10939 external_mini_cluster.cc:1428] Setting key b616d71d6b1d10d1c2001e7165d8c3b2
I20260807 18:43:39.233337 16819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c: Bootstrap starting.
I20260807 18:43:39.235862 16819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:39.236634 16819 log.cc:824] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:39.238430 16819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c: No bootstrap required, opened a new log
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:39.242283 16819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43909 } }
I20260807 18:43:39.242563 16819 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:39.242631 16819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb3101d8a6f4413b7ad1381ce14c19c, State: Initialized, Role: FOLLOWER
I20260807 18:43:39.243089 16819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43909 } }
I20260807 18:43:39.243268 16819 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:39.243361 16819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:39.243459 16819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:39.244513 16819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43909 } }
I20260807 18:43:39.244848 16819 leader_election.cc:302] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cb3101d8a6f4413b7ad1381ce14c19c; no voters:
I20260807 18:43:39.245143 16819 leader_election.cc:288] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:39.245249 16825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:39.245378 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.231345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50402 (local address 127.10.174.254:43909)
0807 18:43:39.231774 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.231792 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.231834 (+ 42us) server_negotiation.cc:407] Connection header received
0807 18:43:39.232638 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.232660 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.233050 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.233391 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.234110 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.235604 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.236479 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.237137 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.237261 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.239770 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.239777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.239794 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.239823 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.242317 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.242797 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.242803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.242808 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.242945 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.243216 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.243219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.243221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.243742 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.243944 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.244152 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.244446 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":107,"threads_started":1}
I20260807 18:43:39.245493 16825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [term 1 LEADER]: Becoming Leader. State: Replica: 4cb3101d8a6f4413b7ad1381ce14c19c, State: Running, Role: LEADER
I20260807 18:43:39.245821 16825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43909 } }
I20260807 18:43:39.246343 16819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:39.247438 16827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cb3101d8a6f4413b7ad1381ce14c19c. Latest consensus state: current_term: 1 leader_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43909 } } }
I20260807 18:43:39.247563 16827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:39.248771 16834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:39.248741 16826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb3101d8a6f4413b7ad1381ce14c19c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43909 } } }
I20260807 18:43:39.249228 16826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:39.251597 16834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:39.256381 16834 catalog_manager.cc:1347] Generated new cluster ID: 5d794efc00e9413b9c912cd55fbdd09b
I20260807 18:43:39.256438 16834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:39.265586 16834 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:39.266433 16834 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:39.272150 16834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cb3101d8a6f4413b7ad1381ce14c19c: Generated new TSK 0
I20260807 18:43:39.272760 16834 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:39.304180 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43909
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:39.416251 16846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:39.416465 16846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:39.416505 16846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:39.420733 16846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:39.420781 16846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:39.420874 16846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:39.425771 16846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:39.426729 16846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:39.427764 16846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:39.436647 16856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:39.436650 16854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:39.436725 16846 server_base.cc:1034] running on GCE node
W20260807 18:43:39.436908 16853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:39.437289 16846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:39.437858 16846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:39.439049 16846 hybrid_clock.cc:648] HybridClock initialized: now 1786128219439021 us; error 40 us; skew 500 ppm
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.441628 16846 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:39.442400 16846 webserver.cc:460] Webserver started at http://127.10.174.193:40379/ using document root <none> and password file <none>
I20260807 18:43:39.442921 16846 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:39.443007 16846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:39.443221 16846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:39.445129 16846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "c39d3bc2460e4da4889cad2e169f58a4"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "fbf26cebc48b3894b03830a47e951dc3"
server_key_iv: "225ad7aaca4ceaedb29496986dce7a8e"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.445674 16846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "c39d3bc2460e4da4889cad2e169f58a4"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "fbf26cebc48b3894b03830a47e951dc3"
server_key_iv: "225ad7aaca4ceaedb29496986dce7a8e"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.449785 16846 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 18:43:39.452172 16864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.453330 16846 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:39.453464 16846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "c39d3bc2460e4da4889cad2e169f58a4"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "fbf26cebc48b3894b03830a47e951dc3"
server_key_iv: "225ad7aaca4ceaedb29496986dce7a8e"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.453596 16846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:39.466400 16846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:39.469357 16846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:39.469547 16846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:39.470103 16846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:39.470880 16846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:39.470948 16846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.471015 16846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:39.471064 16846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.479477 16846 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:39101
I20260807 18:43:39.479532 16989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:39101 every 8 connection(s)
I20260807 18:43:39.480294 16846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:39.490521 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16846
I20260807 18:43:39.490674 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:39.490970 10939 external_mini_cluster.cc:1428] Setting key d1d846c1eea112be9a121a8e54bf37e9
I20260807 18:43:39.493376 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.481925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:48521 (local address 127.10.174.254:43909)
0807 18:43:39.482062 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.482066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.482770 (+ 704us) server_negotiation.cc:407] Connection header received
0807 18:43:39.484130 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.484133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.484192 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.484279 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.485370 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.485957 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.487068 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.487369 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.487480 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.489851 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.489855 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.489864 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.489889 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.491443 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.491924 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.491928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.491930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.492015 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.492351 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.492354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.492356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.492529 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.492636 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.493088 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.493208 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:43:39.494086 16992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.482186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43909 (local address 127.10.174.193:48521)
0807 18:43:39.482618 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:39.482658 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:39.483919 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:39.484447 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:39.484452 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:39.484786 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:39.485223 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:39.485236 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.486087 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.486097 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:39.486942 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:39.486950 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.487518 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.487522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:39.487685 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.488269 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:39.488284 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:39.489688 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:39.491559 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:39.491564 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:39.491577 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:39.491820 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:39.492108 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:39.492112 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:39.492115 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:39.492252 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:39.492635 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:39.492641 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:39.492865 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 18:43:39.493044 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 18:43:39.493344 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":106,"threads_started":1}
I20260807 18:43:39.495375 16990 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43909
I20260807 18:43:39.495595 16990 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:39.496031 16990 heartbeater.cc:511] Master 127.10.174.254:43909 requested a full tablet report, sending...
I20260807 18:43:39.497400 16782 ts_manager.cc:194] Registered new tserver with Master: c39d3bc2460e4da4889cad2e169f58a4 (127.10.174.193:39101)
I20260807 18:43:39.498526 16782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:48521
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:39.516208 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43909
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:39.627796 16995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:39.628015 16995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:39.628057 16995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:39.632027 16995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:39.632076 16995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:39.632130 16995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:39.637002 16995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:39.637841 16995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:39.638713 16995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:39.647688 17001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:39.647746 17000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:39.647717 17003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:39.648066 16995 server_base.cc:1034] running on GCE node
I20260807 18:43:39.648442 16995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:39.649000 16995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:39.650174 16995 hybrid_clock.cc:648] HybridClock initialized: now 1786128219650156 us; error 28 us; skew 500 ppm
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.652832 16995 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:39.653604 16995 webserver.cc:460] Webserver started at http://127.10.174.194:46383/ using document root <none> and password file <none>
I20260807 18:43:39.654117 16995 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:39.654206 16995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:39.654422 16995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:39.656363 16995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "a0bca6e859b642ad8388b0538672b253"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "e383fa2d2425767a79d767eeb58280b7"
server_key_iv: "bd0552df8b8ea37da7c964bc8d4a4453"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.656929 16995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "a0bca6e859b642ad8388b0538672b253"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "e383fa2d2425767a79d767eeb58280b7"
server_key_iv: "bd0552df8b8ea37da7c964bc8d4a4453"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.660554 16995 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:43:39.662689 17010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.663851 16995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:39.663982 16995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "a0bca6e859b642ad8388b0538672b253"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "e383fa2d2425767a79d767eeb58280b7"
server_key_iv: "bd0552df8b8ea37da7c964bc8d4a4453"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.664098 16995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:39.674278 16995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:39.677299 16995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:39.677493 16995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:39.678022 16995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:39.678769 16995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:39.678838 16995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.678907 16995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:39.678949 16995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.687728 16995 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:41403
I20260807 18:43:39.687758 17126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:41403 every 8 connection(s)
I20260807 18:43:39.688510 16995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:39.691620 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 16995
I20260807 18:43:39.691741 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:39.692047 10939 external_mini_cluster.cc:1428] Setting key c9a9d0070e0f5c5053fd4dc49fa8aa9d
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:39.702648 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.690239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:49517 (local address 127.10.174.254:43909)
0807 18:43:39.690412 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.690416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.691247 (+ 831us) server_negotiation.cc:407] Connection header received
0807 18:43:39.692747 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.692751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.692808 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.692886 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.693953 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.694484 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.696028 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.696251 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.696336 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.699093 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.699096 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.699099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.699123 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.700613 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.701104 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.701109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.701110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.701195 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.701544 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.701548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.701550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.701730 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.701838 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.702334 (+ 496us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.702483 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 18:43:39.703594 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.690579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43909 (local address 127.10.174.194:49517)
0807 18:43:39.691089 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:39.691130 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:39.692548 (+ 1418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:39.693051 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:39.693057 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:39.693377 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:39.693813 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:39.693826 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.694620 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.694629 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:39.695898 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:39.695911 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.696404 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.696411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:39.696643 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.697230 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:39.697262 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:39.698934 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:39.700732 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:39.700737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:39.700757 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:39.701001 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:39.701299 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:39.701303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:39.701305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:39.701446 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:39.701836 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:39.701843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:39.702092 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 18:43:39.702267 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 18:43:39.702569 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
I20260807 18:43:39.704808 17127 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43909
I20260807 18:43:39.705060 17127 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:39.705523 17127 heartbeater.cc:511] Master 127.10.174.254:43909 requested a full tablet report, sending...
I20260807 18:43:39.706596 16782 ts_manager.cc:194] Registered new tserver with Master: a0bca6e859b642ad8388b0538672b253 (127.10.174.194:41403)
I20260807 18:43:39.707170 16782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:49517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:39.720340 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43909
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:39.829523 17132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:39.829772 17132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:39.829814 17132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:39.833822 17132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:39.833873 17132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:39.833977 17132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:39.839058 17132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:43909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:39.840101 17132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:39.841118 17132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:39.850412 17137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:39.850426 17138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:39.850517 17140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:39.850800 17132 server_base.cc:1034] running on GCE node
I20260807 18:43:39.851179 17132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:39.851809 17132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:39.852965 17132 hybrid_clock.cc:648] HybridClock initialized: now 1786128219852932 us; error 47 us; skew 500 ppm
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.855741 17132 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:39.856652 17132 webserver.cc:460] Webserver started at http://127.10.174.195:43751/ using document root <none> and password file <none>
I20260807 18:43:39.857194 17132 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:39.857255 17132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:39.857474 17132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:39.859573 17132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "e21b849f388d45e6b789d6f3caba8da1"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "8390d263a8c42a68714bad8567429b0b"
server_key_iv: "d39735a8fa175f94290c38b1854d849d"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.860085 17132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "e21b849f388d45e6b789d6f3caba8da1"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "8390d263a8c42a68714bad8567429b0b"
server_key_iv: "d39735a8fa175f94290c38b1854d849d"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.863677 17132 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:39.865974 17148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.867256 17132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:39.867448 17132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "e21b849f388d45e6b789d6f3caba8da1"
format_stamp: "Formatted at 2026-08-07 18:43:39 on dist-test-slave-07c2"
server_key: "8390d263a8c42a68714bad8567429b0b"
server_key_iv: "d39735a8fa175f94290c38b1854d849d"
server_key_version: "encryptionkey@0"
I20260807 18:43:39.867584 17132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:39.878934 17132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:39.881678 17132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:39.881871 17132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:39.882406 17132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:39.883165 17132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:39.883236 17132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.883297 17132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:39.883406 17132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:39.892365 17132 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39243
I20260807 18:43:39.892397 17271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39243 every 8 connection(s)
I20260807 18:43:39.893205 17132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:39.896626 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17132
I20260807 18:43:39.896759 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:39.897037 10939 external_mini_cluster.cc:1428] Setting key a9baf84982ee00425b6187af4d68b121
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:39.906270 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.894827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:44523 (local address 127.10.174.254:43909)
0807 18:43:39.894993 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.894999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.895777 (+ 778us) server_negotiation.cc:407] Connection header received
0807 18:43:39.897147 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.897151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.897211 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.897290 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.898582 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.899182 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.900305 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.900509 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.900587 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.902889 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.902891 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.902893 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.902917 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.904286 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.904792 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.904795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.904797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.904880 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.905217 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.905221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.905224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.905405 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.905513 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.905977 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.906097 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 18:43:39.906955 17274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.895182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43909 (local address 127.10.174.195:44523)
0807 18:43:39.895629 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:39.895671 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:39.896944 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:39.897448 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:39.897454 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:39.897909 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:39.898437 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:39.898456 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.899335 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.899339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:39.900204 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:39.900213 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.900657 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.900661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:39.900797 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.901297 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:39.901312 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:39.902713 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:39.904409 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:39.904414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:39.904427 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:39.904669 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:39.904984 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:39.904987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:39.904989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:39.905119 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:39.905523 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:39.905531 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:39.905754 (+ 223us) client_negotiation.cc:769] Sending connection context
0807 18:43:39.905934 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 18:43:39.906221 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":126,"threads_started":1}
I20260807 18:43:39.907990 17272 heartbeater.cc:347] Connected to a master server at 127.10.174.254:43909
I20260807 18:43:39.908236 17272 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:39.908710 17272 heartbeater.cc:511] Master 127.10.174.254:43909 requested a full tablet report, sending...
I20260807 18:43:39.909690 16782 ts_manager.cc:194] Registered new tserver with Master: e21b849f388d45e6b789d6f3caba8da1 (127.10.174.195:39243)
I20260807 18:43:39.910429 16782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:44523
I20260807 18:43:39.910832 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/test-admin.keytab.
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.926792 10939 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 18:43:39.929687 17279 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:39.928181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51876 (local address 127.10.174.193:39101)
0807 18:43:39.928563 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.928573 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.928595 (+ 22us) server_negotiation.cc:407] Connection header received
0807 18:43:39.928641 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.928645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.928819 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.928968 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.929484 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51876: BlockingRecv error: recv got EOF from 127.0.0.1:51876 (error 108)
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":138,"threads_started":1}
W20260807 18:43:39.929778 10939 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc' of type FILE
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.930799 10939 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.931836 10939 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:39.940730 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.932722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51882 (local address 127.10.174.193:39101)
0807 18:43:39.932860 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.932863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.932876 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:43:39.932983 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.932985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.933021 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.933091 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.933585 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.934326 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.935084 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.935493 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.935583 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.937676 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.937684 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.937695 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.937715 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.939109 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.939557 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.939581 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.939582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.939659 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.939905 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.939907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.939908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.940105 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.940240 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.940404 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.940583 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 18:43:39.944232 17279 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:39.943321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51890 (local address 127.10.174.193:39101)
0807 18:43:39.943422 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.943426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.943498 (+ 72us) server_negotiation.cc:407] Connection header received
0807 18:43:39.943621 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.943624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.943666 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.943746 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.944118 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51890: BlockingRecv error: recv got EOF from 127.0.0.1:51890 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 18:43:39.944407 10939 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc' of type FILE
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.945307 10939 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.946174 10939 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:39.954398 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.946947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.10.174.193:39101)
0807 18:43:39.947071 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.947075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.947191 (+ 116us) server_negotiation.cc:407] Connection header received
0807 18:43:39.947405 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.947408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.947444 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.947532 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.948052 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.948580 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.949366 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.949608 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.949712 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.951703 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.951707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.951709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.951739 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.952879 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.953292 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.953296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.953297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.953374 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.953646 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.953651 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.953652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.953807 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.953934 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.954160 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.954268 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 18:43:39.957126 17279 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:39.956041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51908 (local address 127.10.174.193:39101)
0807 18:43:39.956156 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.956160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.956279 (+ 119us) server_negotiation.cc:407] Connection header received
0807 18:43:39.956389 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.956393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.956428 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.956516 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.957017 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51908: BlockingRecv error: recv got EOF from 127.0.0.1:51908 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 18:43:39.957327 10939 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786128190976416-10939-0/krb5kdc/krb5cc' of type FILE
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.958302 10939 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:39.959398 10939 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 18:43:39 dist-test-slave-07c2 krb5kdc[16737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:43:39.967510 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:39.960067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51914 (local address 127.10.174.193:39101)
0807 18:43:39.960190 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:39.960194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:39.960314 (+ 120us) server_negotiation.cc:407] Connection header received
0807 18:43:39.960426 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:39.960429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:39.960463 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:39.960552 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:39.961012 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.961484 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.962240 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:39.962466 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:39.962572 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:39.964615 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:39.964619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:39.964621 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:39.964644 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:39.965857 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.966298 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.966301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.966303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.966382 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:39.966659 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:39.966663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:39.966665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:39.966874 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:39.967000 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:39.967233 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 18:43:39.967368 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:43:39.968456 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16846
I20260807 18:43:39.976138 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16995
I20260807 18:43:39.982573 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17132
I20260807 18:43:39.988615 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 16750
2026-08-07T18:43:39Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2108 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:40 dist-test-slave-07c2 krb5kdc[17293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:40 dist-test-slave-07c2 krb5kdc[17293](info): set up 2 sockets
Aug 07 18:43:40 dist-test-slave-07c2 krb5kdc[17293](info): commencing operation
krb5kdc: starting...
W20260807 18:43:41.041679 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:41 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:41Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab.
Entry for principal oryx/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab.
I20260807 18:43:41.162444 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:35247
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab
--principal=oryx/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:35247
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:41.269344 17306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:41.269627 17306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:41.269726 17306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:41.273697 17306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:41.273778 17306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:41.273815 17306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:41.273875 17306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:41.273909 17306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:41.278968 17306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:35247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab
--principal=oryx/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:35247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:41.279983 17306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:41.280972 17306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:41.289214 17315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:41.289223 17313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:41.289223 17311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:41.289330 17306 server_base.cc:1034] running on GCE node
I20260807 18:43:41.290012 17306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:41.291035 17306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:41.292219 17306 hybrid_clock.cc:648] HybridClock initialized: now 1786128221292198 us; error 33 us; skew 500 ppm
Aug 07 18:43:41 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:41.294777 17306 init.cc:377] Logged in from keytab as oryx/127.10.174.254@KRBTEST.COM (short username oryx)
I20260807 18:43:41.295645 17306 webserver.cc:460] Webserver started at http://127.10.174.254:40733/ using document root <none> and password file <none>
I20260807 18:43:41.296168 17306 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:41.296257 17306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:41.296476 17306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:41.298501 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "02fa2654bab74c528745865c14b78eaf"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "10dcaf5eec99bde505ffee9b69d16864"
server_key_iv: "40b3a68d6e12123ef80ceac97d790a03"
server_key_version: "encryptionkey@0"
I20260807 18:43:41.299062 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "02fa2654bab74c528745865c14b78eaf"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "10dcaf5eec99bde505ffee9b69d16864"
server_key_iv: "40b3a68d6e12123ef80ceac97d790a03"
server_key_version: "encryptionkey@0"
I20260807 18:43:41.302575 17306 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:43:41.304921 17322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:41.306013 17306 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:41.306149 17306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "02fa2654bab74c528745865c14b78eaf"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "10dcaf5eec99bde505ffee9b69d16864"
server_key_iv: "40b3a68d6e12123ef80ceac97d790a03"
server_key_version: "encryptionkey@0"
I20260807 18:43:41.306257 17306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:41.349834 17306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:41.352610 17306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:41.352824 17306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:41.359472 17306 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:35247
I20260807 18:43:41.359766 17376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:35247 every 8 connection(s)
I20260807 18:43:41.360419 17306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:41.363107 17377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:41.368296 17377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Bootstrap starting.
I20260807 18:43:41.368628 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17306
I20260807 18:43:41.368786 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:41.369069 10939 external_mini_cluster.cc:1428] Setting key 3af68574c6b397cf2fd5c4b143fb424e
I20260807 18:43:41.370863 17377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:41.371752 17377 log.cc:824] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:41.373498 17377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: No bootstrap required, opened a new log
I20260807 18:43:41.376343 17377 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } }
I20260807 18:43:41.376564 17377 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:41.376636 17377 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02fa2654bab74c528745865c14b78eaf, State: Initialized, Role: FOLLOWER
I20260807 18:43:41.377080 17377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } }
I20260807 18:43:41.377225 17377 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:41.377317 17377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:41.377413 17377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:41.378209 17377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } }
Aug 07 18:43:41 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:41.378583 17377 leader_election.cc:302] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02fa2654bab74c528745865c14b78eaf; no voters:
I20260807 18:43:41.378855 17377 leader_election.cc:288] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:41.379007 17382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:41.379225 17382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 LEADER]: Becoming Leader. State: Replica: 02fa2654bab74c528745865c14b78eaf, State: Running, Role: LEADER
I20260807 18:43:41.379791 17382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } }
I20260807 18:43:41.380185 17377 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:41.381348 17384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02fa2654bab74c528745865c14b78eaf. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } }
I20260807 18:43:41.381501 17384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:41.381836 17383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } }
I20260807 18:43:41.381933 17383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:41.382220 17391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:41.384459 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:41.370380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60256 (local address 127.10.174.254:35247)
0807 18:43:41.370817 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:41.370838 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:41.370880 (+ 42us) server_negotiation.cc:407] Connection header received
0807 18:43:41.371748 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:41.371770 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:41.372170 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:41.372490 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:41.373308 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:41.374335 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:41.375206 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:41.376154 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:41.376322 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:41.379126 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:41.379132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:41.379146 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:41.379175 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:41.381258 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:41.381825 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:41.381834 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:41.381842 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:41.381996 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:41.382323 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:41.382327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:41.382328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:41.382835 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:41.383036 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:41.383455 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 18:43:41.383820 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":115,"threads_started":1}
I20260807 18:43:41.385335 17391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:41.390370 17391 catalog_manager.cc:1347] Generated new cluster ID: a45c5784cc2b46fba8a11ecf70bc1df1
I20260807 18:43:41.390432 17391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:41.403882 17391 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:41.404682 17391 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:41.411626 17391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Generated new TSK 0
I20260807 18:43:41.412225 17391 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab.
Entry for principal oryx/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab.
I20260807 18:43:41.443809 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35247
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:41.631520 17403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:41.631966 17403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:41.632037 17403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:41.638751 17403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:41.638849 17403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:41.638942 17403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:41.648597 17403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:41.650493 17403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:41.652508 17403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:41.670421 17408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:41.670421 17411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:41.670409 17409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:41.671770 17403 server_base.cc:1034] running on GCE node
I20260807 18:43:41.672641 17403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:41.673645 17403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:41.677004 17403 hybrid_clock.cc:648] HybridClock initialized: now 1786128221676954 us; error 89 us; skew 500 ppm
Aug 07 18:43:41 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:41.682958 17403 init.cc:377] Logged in from keytab as oryx/127.10.174.193@KRBTEST.COM (short username oryx)
I20260807 18:43:41.684671 17403 webserver.cc:460] Webserver started at http://127.10.174.193:43587/ using document root <none> and password file <none>
I20260807 18:43:41.685645 17403 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:41.685782 17403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:41.686174 17403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:41.690485 17403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "e8aeb11509944b308a29bb6317067066"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "816af9887e1cbdd9200b1225fa350f03"
server_key_iv: "036a2f7c404b6486f86c17d7cef37b36"
server_key_version: "encryptionkey@0"
I20260807 18:43:41.691677 17403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "e8aeb11509944b308a29bb6317067066"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "816af9887e1cbdd9200b1225fa350f03"
server_key_iv: "036a2f7c404b6486f86c17d7cef37b36"
server_key_version: "encryptionkey@0"
I20260807 18:43:41.699067 17403 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260807 18:43:41.703186 17418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:41.705330 17403 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:43:41.705571 17403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "e8aeb11509944b308a29bb6317067066"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "816af9887e1cbdd9200b1225fa350f03"
server_key_iv: "036a2f7c404b6486f86c17d7cef37b36"
server_key_version: "encryptionkey@0"
I20260807 18:43:41.705766 17403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:41.735569 17403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:41.740724 17403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:41.741096 17403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:41.742103 17403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:41.743548 17403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:41.743654 17403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:41.743840 17403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:41.743914 17403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:41.759577 17403 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:39873
I20260807 18:43:41.759608 17536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:39873 every 8 connection(s)
I20260807 18:43:41.761117 17403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:41.763651 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17403
I20260807 18:43:41.763880 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:41.764521 10939 external_mini_cluster.cc:1428] Setting key ab40d3a2543697f30a21380fd01f2529
Aug 07 18:43:41 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.194@KRBTEST.COM" created.
I20260807 18:43:41.786378 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:41.764309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:33795 (local address 127.10.174.254:35247)
0807 18:43:41.764559 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:41.764564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:41.766363 (+ 1799us) server_negotiation.cc:407] Connection header received
0807 18:43:41.768834 (+ 2471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:41.768841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:41.768962 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:41.769144 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:41.771046 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:41.771895 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:41.773849 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:41.774190 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:41.774402 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:41.778535 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:41.778539 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:41.778542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:41.778595 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:41.782211 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:41.783049 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:41.783065 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:41.783070 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:41.783235 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:41.783843 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:41.783858 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:41.783872 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:41.784531 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:41.784788 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:41.785779 (+ 991us) server_negotiation.cc:299] Negotiation successful
0807 18:43:41.786014 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 18:43:41.788079 17539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:41.765075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:33795)
0807 18:43:41.766034 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:41.766163 (+ 129us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:41.768509 (+ 2346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:41.769351 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:41.769358 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:41.770021 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:41.770810 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:41.770834 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:41.772102 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:41.772115 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:41.773581 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:41.773597 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:41.774503 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:41.774508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:41.774813 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:41.775884 (+ 1071us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:41.775909 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:41.778257 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:41.782411 (+ 4154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:41.782424 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:41.782446 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:41.782916 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:41.783411 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:41.783414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:41.783421 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:41.783676 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:41.784782 (+ 1106us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:41.784788 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:41.785266 (+ 478us) client_negotiation.cc:769] Sending connection context
0807 18:43:41.785708 (+ 442us) client_negotiation.cc:240] Negotiation successful
0807 18:43:41.786362 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":305,"threads_started":1}
I20260807 18:43:41.791107 17537 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35247
I20260807 18:43:41.791697 17537 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:41.793027 17537 heartbeater.cc:511] Master 127.10.174.254:35247 requested a full tablet report, sending...
I20260807 18:43:41.796583 17339 ts_manager.cc:194] Registered new tserver with Master: e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873)
I20260807 18:43:41.799886 17339 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:33795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab.
Entry for principal oryx/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab.
I20260807 18:43:41.821101 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35247
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:42.028031 17542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:42.028519 17542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:42.028708 17542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:42.035820 17542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:42.035903 17542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:42.036131 17542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:42.045318 17542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:42.047263 17542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:42.049283 17542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:42.066880 17550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:42.067202 17542 server_base.cc:1034] running on GCE node
W20260807 18:43:42.066847 17548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:42.066847 17547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:42.068365 17542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:42.069612 17542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:42.070966 17542 hybrid_clock.cc:648] HybridClock initialized: now 1786128222070921 us; error 43 us; skew 500 ppm
Aug 07 18:43:42 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:42.076229 17542 init.cc:377] Logged in from keytab as oryx/127.10.174.194@KRBTEST.COM (short username oryx)
I20260807 18:43:42.077876 17542 webserver.cc:460] Webserver started at http://127.10.174.194:43557/ using document root <none> and password file <none>
I20260807 18:43:42.078907 17542 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:42.079097 17542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:42.079682 17542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:42.083822 17542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "bee4edfa7e7761ee7aaa25693dd61557"
server_key_iv: "a719b05d0eca72dc03a68192e6c4acfe"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.084888 17542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "bee4edfa7e7761ee7aaa25693dd61557"
server_key_iv: "a719b05d0eca72dc03a68192e6c4acfe"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.092068 17542 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260807 18:43:42.095994 17558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.098093 17542 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:43:42.098300 17542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "bee4edfa7e7761ee7aaa25693dd61557"
server_key_iv: "a719b05d0eca72dc03a68192e6c4acfe"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.098472 17542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:42.162948 17542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:42.169584 17542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:42.169997 17542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:42.171147 17542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:42.172868 17542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:42.172971 17542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.173133 17542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:42.173228 17542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.191105 17542 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44815
I20260807 18:43:42.191140 17674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44815 every 8 connection(s)
I20260807 18:43:42.192726 17542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:42.203169 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17542
I20260807 18:43:42.203405 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:42.203938 10939 external_mini_cluster.cc:1428] Setting key 94cec7d0545d4bc450800f4317fc3f7d
Aug 07 18:43:42 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:42.217962 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:42.195886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58397 (local address 127.10.174.254:35247)
0807 18:43:42.196072 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:42.196076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:42.197901 (+ 1825us) server_negotiation.cc:407] Connection header received
0807 18:43:42.199176 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:42.199181 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:42.199254 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:42.199456 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:42.201304 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.202100 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.204165 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.204764 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.205105 (+ 341us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:42.209840 (+ 4735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:42.209856 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:42.209865 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:42.209931 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:42.213538 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:42.214735 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:42.214739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:42.214740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:42.214869 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:42.215779 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:42.215782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:42.215783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:42.216090 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:42.216415 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:42.217540 (+ 1125us) server_negotiation.cc:299] Negotiation successful
0807 18:43:42.217791 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 18:43:42.220666 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:42.196648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:58397)
0807 18:43:42.197628 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:42.197683 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:42.198857 (+ 1174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:42.199757 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:42.199778 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:42.200376 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:42.201126 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:42.201150 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.202358 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.202369 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:42.203980 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:42.203995 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.205126 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.205135 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:42.205438 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:42.206745 (+ 1307us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:42.206792 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:42.209548 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:42.213708 (+ 4160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:42.213725 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:42.213756 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:42.214574 (+ 818us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:42.215102 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:42.215109 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:42.215120 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:42.215464 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:42.216413 (+ 949us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:42.216430 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:42.217122 (+ 692us) client_negotiation.cc:769] Sending connection context
0807 18:43:42.217466 (+ 344us) client_negotiation.cc:240] Negotiation successful
0807 18:43:42.218184 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"thread_start_us":157,"threads_started":1}
I20260807 18:43:42.222805 17675 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35247
I20260807 18:43:42.223230 17675 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:42.224059 17675 heartbeater.cc:511] Master 127.10.174.254:35247 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:42.225732 17339 ts_manager.cc:194] Registered new tserver with Master: 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815)
I20260807 18:43:42.226758 17339 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:58397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab.
Entry for principal oryx/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab.
I20260807 18:43:42.248328 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35247
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:42.470203 17680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:42.470649 17680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:42.470803 17680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:42.477427 17680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:42.477536 17680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:42.477743 17680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:42.487771 17680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:42.489909 17680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:42.492154 17680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:42.509536 17688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:42.509446 17686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:42.509446 17685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:42.510762 17680 server_base.cc:1034] running on GCE node
I20260807 18:43:42.511590 17680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:42.512843 17680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:42.514276 17680 hybrid_clock.cc:648] HybridClock initialized: now 1786128222514258 us; error 137 us; skew 500 ppm
Aug 07 18:43:42 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:42.519361 17680 init.cc:377] Logged in from keytab as oryx/127.10.174.195@KRBTEST.COM (short username oryx)
I20260807 18:43:42.520965 17680 webserver.cc:460] Webserver started at http://127.10.174.195:38851/ using document root <none> and password file <none>
I20260807 18:43:42.521863 17680 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:42.522019 17680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:42.522476 17680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:42.526264 17680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "ed82c5042ddd41808def79d8e43743a2"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "033902f3376e18608c8f242c331e5655"
server_key_iv: "f2b1ad5bf7af749f1c4497ce5e06ba46"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.527490 17680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "ed82c5042ddd41808def79d8e43743a2"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "033902f3376e18608c8f242c331e5655"
server_key_iv: "f2b1ad5bf7af749f1c4497ce5e06ba46"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.534511 17680 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 18:43:42.538914 17695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.541154 17680 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 18:43:42.541407 17680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "ed82c5042ddd41808def79d8e43743a2"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "033902f3376e18608c8f242c331e5655"
server_key_iv: "f2b1ad5bf7af749f1c4497ce5e06ba46"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.541602 17680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:42.581322 17680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:42.586962 17680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:42.587391 17680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:42.588481 17680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:42.589956 17680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:42.590071 17680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.590209 17680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:42.590297 17680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.609135 17680 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:45327
I20260807 18:43:42.609303 17812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:45327 every 8 connection(s)
I20260807 18:43:42.610983 17680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:42.613052 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17680
I20260807 18:43:42.613335 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:42.614161 10939 external_mini_cluster.cc:1428] Setting key 291328d91d44324aa6a50e0619347c7f
Aug 07 18:43:42 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:42.637108 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:42.615113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:50693 (local address 127.10.174.254:35247)
0807 18:43:42.615389 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:42.615404 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:42.617521 (+ 2117us) server_negotiation.cc:407] Connection header received
0807 18:43:42.620461 (+ 2940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:42.620464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:42.620539 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:42.620653 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:42.622751 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.623729 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.625821 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.626118 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.626259 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:42.631064 (+ 4805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:42.631067 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:42.631069 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:42.631122 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:42.633774 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:42.634603 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:42.634612 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:42.634613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:42.634752 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:42.635398 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:42.635400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:42.635401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:42.635767 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:42.635920 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:42.636721 (+ 801us) server_negotiation.cc:299] Negotiation successful
0807 18:43:42.636921 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 18:43:42.638801 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:42.616100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:50693)
0807 18:43:42.617173 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:42.617302 (+ 129us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:42.620140 (+ 2838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:42.620925 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:42.620942 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:42.621612 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:42.622548 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:42.622572 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.623881 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.623891 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:42.625624 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:42.625646 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:42.626320 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:42.626324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:42.626615 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:42.627714 (+ 1099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:42.627735 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:42.630761 (+ 3026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:42.633957 (+ 3196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:42.633970 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:42.633984 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:42.634474 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:42.634869 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:42.634878 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:42.634879 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:42.635192 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:42.635918 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:42.635923 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:42.636377 (+ 454us) client_negotiation.cc:769] Sending connection context
0807 18:43:42.636653 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 18:43:42.637140 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":324,"threads_started":1}
I20260807 18:43:42.640769 17813 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35247
I20260807 18:43:42.641161 17813 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:42.642009 17813 heartbeater.cc:511] Master 127.10.174.254:35247 requested a full tablet report, sending...
I20260807 18:43:42.643846 17339 ts_manager.cc:194] Registered new tserver with Master: ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327)
I20260807 18:43:42.644842 17339 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:50693
I20260807 18:43:42.657150 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.253.keytab.
Entry for principal oryx/127.10.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.253.keytab.
I20260807 18:43:42.699065 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:39887
--webserver_interface=127.10.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.253.keytab
--principal=oryx/127.10.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:35247,127.10.174.253:39887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:43:42.806557 17537 heartbeater.cc:503] Master 127.10.174.254:35247 was elected leader, sending a full tablet report...
W20260807 18:43:42.899986 17818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:42.900413 17818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:42.900484 17818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:42.906189 17818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:42.906314 17818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:42.906440 17818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:42.906541 17818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:42.906613 17818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:42.915395 17818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:35247,127.10.174.253:39887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.253.keytab
--principal=oryx/127.10.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:39887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
W20260807 18:43:42.915773 17818 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.174.254:35247,127.10.174.253:39887'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 18:43:42.917263 17818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:42.918953 17818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:42.931850 17823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:42.931857 17826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:42.931857 17824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:42.932145 17818 server_base.cc:1034] running on GCE node
I20260807 18:43:42.933144 17818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:42.934762 17818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:42.935977 17818 hybrid_clock.cc:648] HybridClock initialized: now 1786128222935901 us; error 102 us; skew 500 ppm
Aug 07 18:43:42 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:42.940310 17818 init.cc:377] Logged in from keytab as oryx/127.10.174.253@KRBTEST.COM (short username oryx)
I20260807 18:43:42.941646 17818 webserver.cc:460] Webserver started at http://127.10.174.253:38259/ using document root <none> and password file <none>
I20260807 18:43:42.942417 17818 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:42.942513 17818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:42.942776 17818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:42.945844 17818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/instance:
uuid: "225fee289ca44730ba3a74e27dbbf1df"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "be5063ee0bbdc42cf30f0247507b6a14"
server_key_iv: "b93942a4d9763b23449157188f96d0d8"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.946658 17818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal/instance:
uuid: "225fee289ca44730ba3a74e27dbbf1df"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "be5063ee0bbdc42cf30f0247507b6a14"
server_key_iv: "b93942a4d9763b23449157188f96d0d8"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.952818 17818 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260807 18:43:42.956267 17834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:42.958091 17818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:43:42.958294 17818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
uuid: "225fee289ca44730ba3a74e27dbbf1df"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "be5063ee0bbdc42cf30f0247507b6a14"
server_key_iv: "b93942a4d9763b23449157188f96d0d8"
server_key_version: "encryptionkey@0"
I20260807 18:43:42.958456 17818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:42.972198 17818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:42.976390 17818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:42.976694 17818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:42.988551 17818 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.253:39887
I20260807 18:43:42.988979 17887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.253:39887 every 8 connection(s)
I20260807 18:43:42.990159 17818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
I20260807 18:43:42.990726 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17818
I20260807 18:43:42.995539 17888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:43.003188 17888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.253@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:43.017416 17891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:42.993270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49138 (local address 127.10.174.253:39887)
0807 18:43:42.993898 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:42.993938 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:42.994025 (+ 87us) server_negotiation.cc:407] Connection header received
0807 18:43:42.995643 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:42.995678 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:42.996398 (+ 720us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:42.997029 (+ 631us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:42.998047 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.000536 (+ 2489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.001778 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.003042 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.003421 (+ 379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.009243 (+ 5822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.009257 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.009273 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.009349 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.012473 (+ 3124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.013181 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.013189 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.013206 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.013438 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.013892 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.013895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.013906 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.014486 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.014864 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.015450 (+ 586us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.015963 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":187,"threads_started":1}
I20260807 18:43:43.022279 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.006547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.10.174.254:35247)
0807 18:43:43.006799 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.006804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.007610 (+ 806us) server_negotiation.cc:407] Connection header received
0807 18:43:43.007894 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.007897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.007964 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.008065 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.009612 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.010900 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.012436 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.012948 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.013166 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.017134 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.017138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.017140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.017171 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.019392 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.020119 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.020125 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.020155 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.020317 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.020784 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.020794 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.020796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.021106 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.021302 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.021833 (+ 531us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.022013 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 18:43:43.022361 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.006428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60268)
0807 18:43:43.007366 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.007460 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.007716 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.008199 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.008214 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.009148 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.009433 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.009453 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.011099 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.011115 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.012273 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.012284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.013583 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.013587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.013700 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.014499 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.014513 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.016924 (+ 2411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.019579 (+ 2655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.019591 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.019604 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.019945 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.020471 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.020478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.020481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.020620 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.021303 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.021321 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.021490 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.021711 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.022005 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":302,"threads_started":1}
I20260807 18:43:43.023986 17888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128222, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.253@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
I20260807 18:43:43.035411 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.024567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49154)
0807 18:43:43.024730 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.024764 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.024931 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.025260 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.025262 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.025475 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.025600 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.025612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.027124 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.027126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.027904 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.027919 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.028512 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.028522 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.028635 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.029273 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.029295 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.030930 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.033459 (+ 2529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.033461 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.033463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.033798 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.034144 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.034146 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.034147 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.034261 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.034732 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.034734 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.034852 (+ 118us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.034983 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.035151 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 18:43:43.035470 17891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.024699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49154 (local address 127.10.174.253:39887)
0807 18:43:43.024945 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.024949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.024975 (+ 26us) server_negotiation.cc:407] Connection header received
0807 18:43:43.025039 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.025048 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.025094 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.025237 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.025725 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.026958 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.028052 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.028391 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.028519 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.031145 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.031149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.031151 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.031186 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.033313 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.033929 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.033939 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.033940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.034039 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.034374 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.034377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.034378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.034611 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.034720 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.035039 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.035254 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":64}
I20260807 18:43:43.039742 17888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Bootstrap starting.
I20260807 18:43:43.043111 17888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:43.044262 17888 log.cc:824] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:43.047418 17888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: No bootstrap required, opened a new log
I20260807 18:43:43.052362 17888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } }
I20260807 18:43:43.052699 17888 raft_consensus.cc:374] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:43.052829 17888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225fee289ca44730ba3a74e27dbbf1df, State: Initialized, Role: FOLLOWER
I20260807 18:43:43.053488 17888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } }
I20260807 18:43:43.054147 17894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } } }
I20260807 18:43:43.054343 17894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:43.055408 17888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:43:43.062705 17905 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:43.062845 17905 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:43.065754 17818 master_runner.cc:428] Detected that this master 225fee289ca44730ba3a74e27dbbf1df is joining an existing cluster
I20260807 18:43:43.065824 17818 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.174.253:39887
I20260807 18:43:43.085496 17891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.070017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49170 (local address 127.10.174.253:39887)
0807 18:43:43.070193 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.070208 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.070385 (+ 177us) server_negotiation.cc:407] Connection header received
0807 18:43:43.070898 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.070901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.070972 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.071092 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.072275 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.073320 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.075761 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.076188 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.076284 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.078529 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.078537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.078551 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.078613 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.082042 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.083027 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.083042 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.083047 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.083179 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.083773 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.083776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.083778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.084192 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.084340 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.084968 (+ 628us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.085167 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"spinlock_wait_cycles":6016}
I20260807 18:43:43.086369 17911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.069089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60284)
0807 18:43:43.069633 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.069686 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.070315 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.071105 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.071109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.071627 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.071858 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.071868 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.073577 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.073580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.075392 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.075413 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.076655 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.076669 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.076819 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.077700 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.077740 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.078622 (+ 882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.083349 (+ 4727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.083356 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.083358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.083776 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.084405 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.084408 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.084410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.084553 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.085389 (+ 836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.085400 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.085547 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.085743 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.085980 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":211,"spinlock_wait_cycles":19712,"thread_start_us":160,"threads_started":1}
I20260807 18:43:43.087312 17912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.069872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49170)
0807 18:43:43.070248 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.070268 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.070451 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.071342 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.071345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.071847 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.072060 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.072080 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.073594 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.073602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.075481 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.075506 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.076483 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.076486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.076578 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.077361 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.077392 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.078272 (+ 880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.082348 (+ 4076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.082351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.082353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.082820 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.083407 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.083413 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.083429 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.083561 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.084455 (+ 894us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.084460 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.084642 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.086290 (+ 1648us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.086649 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":134,"thread_start_us":159,"threads_started":1}
I20260807 18:43:43.089464 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.069230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.10.174.254:35247)
0807 18:43:43.069461 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.069468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.069841 (+ 373us) server_negotiation.cc:407] Connection header received
0807 18:43:43.070558 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.070571 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.070670 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.070797 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.072124 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.073322 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.075648 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.076213 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.076371 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.078925 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.078933 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.078948 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.079616 (+ 668us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.083136 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.083977 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.083990 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.083992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.084190 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.084745 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.084750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.084763 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.085131 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.085316 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.088007 (+ 2691us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.088263 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
WARNING: no policy specified for oryx/127.10.174.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.252@KRBTEST.COM" created.
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.254@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
I20260807 18:43:43.113684 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.097038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49184)
0807 18:43:43.098382 (+ 1344us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.098491 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.098720 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.099238 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.099246 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.099866 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.100043 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.100057 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.101206 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.101211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.102188 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.102199 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.103006 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.103010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.103225 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.104197 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.104238 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.106989 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.110300 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.110306 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.110321 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.110827 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.111379 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.111390 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.111392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.111519 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.112304 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.112322 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.112537 (+ 215us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.112774 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.113300 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":135,"threads_started":1}
I20260807 18:43:43.113752 17891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.097106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.10.174.253:39887)
0807 18:43:43.097328 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.097344 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.098611 (+ 1267us) server_negotiation.cc:407] Connection header received
0807 18:43:43.098939 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.098942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.099012 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.099164 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.100284 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.101025 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.102445 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.102777 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.103010 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.107277 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.107337 (+ 60us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.107349 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.107387 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.110054 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.110996 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.111011 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.111013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.111124 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.111715 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.111730 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.111734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.112124 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.112303 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.113271 (+ 968us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.113429 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 18:43:43.116284 17339 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.174.253:39887: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df"
member_type: NON_VOTER
last_known_addr {
host: "127.10.174.253"
port: 39887
}
attrs {
promote: true
}
}
dest_uuid: "02fa2654bab74c528745865c14b78eaf"
cas_config_opid_index: -1
I20260807 18:43:43.117408 17339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } }
I20260807 18:43:43.120350 17917 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 225fee289ca44730ba3a74e27dbbf1df (127.10.174.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } }
I20260807 18:43:43.121551 17862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.252.keytab.
Entry for principal oryx/127.10.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.252.keytab.
I20260807 18:43:43.124310 17862 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Refusing update from remote peer 02fa2654bab74c528745865c14b78eaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 18:43:43.124464 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:34455
--webserver_interface=127.10.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.252.keytab
--principal=oryx/127.10.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:43:43.124871 17917 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.174.253:39887
I20260807 18:43:43.125304 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } }
I20260807 18:43:43.125483 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:43.126151 17818 master.cc:537] Master@127.10.174.253:39887 shutting down...
I20260807 18:43:43.127142 17917 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 18:43:43.131124 17324 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 18:43:43.133934 17324 consensus_peers.cc:487] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf -> Peer 225fee289ca44730ba3a74e27dbbf1df (127.10.174.253:39887): Couldn't send request to peer 225fee289ca44730ba3a74e27dbbf1df. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 18:43:43.136786 17818 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:43.137068 17818 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:43.137194 17818 tablet_replica.cc:330] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: stopping tablet replica
I20260807 18:43:43.141706 17818 master.cc:552] Master@127.10.174.253:39887 shutdown complete.
I20260807 18:43:43.141776 17818 master_runner.cc:305] Clearing existing system tablet
I20260807 18:43:43.142004 17818 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.142081 17818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.143148 17818 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 18:43:43.144025 17923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.144229 17818 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.144358 17818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:43.144418 17818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
uuid: "225fee289ca44730ba3a74e27dbbf1df"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "be5063ee0bbdc42cf30f0247507b6a14"
server_key_iv: "b93942a4d9763b23449157188f96d0d8"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.145974 17818 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:43.147907 17818 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 18:43:43.148030 17818 log.cc:1196] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 18:43:43.148309 17818 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Deleting consensus metadata
I20260807 18:43:43.148496 17818 master_runner.cc:315] Copying system tablet from 127.10.174.254:35247
I20260807 18:43:43.149847 17818 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: tablet copy: Beginning tablet copy session from remote peer at address 127.10.174.254:35247
I20260807 18:43:43.157897 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.150483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.10.174.254:35247)
0807 18:43:43.150607 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.150612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.150813 (+ 201us) server_negotiation.cc:407] Connection header received
0807 18:43:43.150955 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.150957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.151011 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.151105 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.151636 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.152173 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.152991 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.153237 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.153347 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.154448 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.154451 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.154454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.154479 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.156209 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.156674 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.156680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.156682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.156772 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.157047 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.157052 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.157053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.157237 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.157346 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.157620 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.157729 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:43:43.157933 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.150426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60294)
0807 18:43:43.150723 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.150735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.150859 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.151121 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.151124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.151423 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.151519 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.151525 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.152285 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.152290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.152872 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.152880 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.153351 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.153355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.153450 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.153989 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.154001 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.154311 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.156314 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.156319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.156321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.156519 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.156858 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.156861 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.156863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.156969 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.157336 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.157339 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.157440 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.157553 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.157701 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":80,"threads_started":1}
I20260807 18:43:43.158766 17361 tablet_copy_service.cc:140] P 02fa2654bab74c528745865c14b78eaf: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 225fee289ca44730ba3a74e27dbbf1df ({username='oryx', principal='oryx/127.10.174.253@KRBTEST.COM'} at 127.0.0.1:60294)
I20260807 18:43:43.158936 17361 tablet_copy_service.cc:161] P 02fa2654bab74c528745865c14b78eaf: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 225fee289ca44730ba3a74e27dbbf1df at {username='oryx', principal='oryx/127.10.174.253@KRBTEST.COM'} at 127.0.0.1:60294: session id = 225fee289ca44730ba3a74e27dbbf1df-00000000000000000000000000000000
I20260807 18:43:43.160362 17361 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:43:43.161798 17818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 18:43:43.163668 17818 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: tablet copy: Starting download of 0 data blocks...
I20260807 18:43:43.163864 17818 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: tablet copy: Starting download of 1 WAL segments...
I20260807 18:43:43.165494 17818 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:43:43.167160 17361 tablet_copy_service.cc:342] P 02fa2654bab74c528745865c14b78eaf: Request end of tablet copy session 225fee289ca44730ba3a74e27dbbf1df-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.174.253@KRBTEST.COM'} at 127.0.0.1:60294
I20260807 18:43:43.167268 17361 tablet_copy_service.cc:433] P 02fa2654bab74c528745865c14b78eaf: ending tablet copy session 225fee289ca44730ba3a74e27dbbf1df-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 225fee289ca44730ba3a74e27dbbf1df
I20260807 18:43:43.174180 17818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:43.175892 17930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.176052 17818 server_base.cc:1034] running on GCE node
W20260807 18:43:43.179685 17933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.179734 17931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.180078 17818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:43.180409 17818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:43.181577 17818 hybrid_clock.cc:648] HybridClock initialized: now 1786128223181549 us; error 42 us; skew 500 ppm
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:43.183115 17818 init.cc:377] Logged in from keytab as oryx/127.10.174.253@KRBTEST.COM (short username oryx)
I20260807 18:43:43.183614 17818 webserver.cc:460] Webserver started at http://127.10.174.253:36047/ using document root <none> and password file <none>
I20260807 18:43:43.183804 17818 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.183857 17818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.184907 17818 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:43.185839 17940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.186066 17818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:43.186161 17818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
uuid: "225fee289ca44730ba3a74e27dbbf1df"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "be5063ee0bbdc42cf30f0247507b6a14"
server_key_iv: "b93942a4d9763b23449157188f96d0d8"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.186260 17818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.219758 17818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:43.221818 17818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:43.227084 17818 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.253:39887
I20260807 18:43:43.227228 17996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.253:39887 every 8 connection(s)
I20260807 18:43:43.227696 17818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
I20260807 18:43:43.229198 17997 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:43:43.229992 17997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Bootstrap starting.
I20260807 18:43:43.230360 17675 heartbeater.cc:503] Master 127.10.174.254:35247 was elected leader, sending a full tablet report...
I20260807 18:43:43.238390 17997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:43:43.238669 17997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Bootstrap complete.
I20260807 18:43:43.239128 17997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } }
I20260807 18:43:43.239259 17997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 225fee289ca44730ba3a74e27dbbf1df, State: Initialized, Role: LEARNER
I20260807 18:43:43.239392 17997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } }
I20260807 18:43:43.239712 18001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } }
I20260807 18:43:43.239871 18001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: LEARNER
I20260807 18:43:43.239872 17997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:43.242906 18012 catalog_manager.cc:1259] Loaded cluster ID: a45c5784cc2b46fba8a11ecf70bc1df1
I20260807 18:43:43.243002 18012 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: loading cluster ID for follower catalog manager: success
I20260807 18:43:43.244549 18012 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: acquiring CA information for follower catalog manager: success
I20260807 18:43:43.245581 18012 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 18:43:43.284449 17920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:43.284787 17920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:43.284842 17920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:43.290745 17920 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:43.290823 17920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:43.290851 17920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:43.290875 17920 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:43.290897 17920 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:43.298869 17920 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.252.keytab
--principal=oryx/127.10.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:34455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:43.300239 17920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:43.301460 17920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:43.310886 18018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.310889 18017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.311266 18020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.311460 17920 server_base.cc:1034] running on GCE node
I20260807 18:43:43.312141 17920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:43.313265 17920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:43.314424 17920 hybrid_clock.cc:648] HybridClock initialized: now 1786128223314378 us; error 59 us; skew 500 ppm
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:43.317122 17920 init.cc:377] Logged in from keytab as oryx/127.10.174.252@KRBTEST.COM (short username oryx)
I20260807 18:43:43.317915 17920 webserver.cc:460] Webserver started at http://127.10.174.252:32811/ using document root <none> and password file <none>
I20260807 18:43:43.318426 17920 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.318485 17920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.318643 17920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:43.320664 17920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/instance:
uuid: "394ad5f93504429faac6a5c1c4e70f46"
format_stamp: "Formatted at 2026-08-07 18:43:43 on dist-test-slave-07c2"
server_key: "559232d642679720ca3d601469b4e58e"
server_key_iv: "c76487304e36c42fb859ed5fa1a5734a"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.321183 17920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal/instance:
uuid: "394ad5f93504429faac6a5c1c4e70f46"
format_stamp: "Formatted at 2026-08-07 18:43:43 on dist-test-slave-07c2"
server_key: "559232d642679720ca3d601469b4e58e"
server_key_iv: "c76487304e36c42fb859ed5fa1a5734a"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.325424 17920 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:43:43.327795 18028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.328998 17920 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:43.329097 17920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
uuid: "394ad5f93504429faac6a5c1c4e70f46"
format_stamp: "Formatted at 2026-08-07 18:43:43 on dist-test-slave-07c2"
server_key: "559232d642679720ca3d601469b4e58e"
server_key_iv: "c76487304e36c42fb859ed5fa1a5734a"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.329188 17920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.359129 17920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:43.362484 17920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:43.362663 17920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:43.371472 17920 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.252:34455
I20260807 18:43:43.371790 18081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.252:34455 every 8 connection(s)
I20260807 18:43:43.372625 17920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
I20260807 18:43:43.375321 18082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:43.377820 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 17920
I20260807 18:43:43.379330 18082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.252@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.174.252@KRBTEST.COM
I20260807 18:43:43.391214 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.381098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60310 (local address 127.10.174.254:35247)
0807 18:43:43.381249 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.381254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.381549 (+ 295us) server_negotiation.cc:407] Connection header received
0807 18:43:43.381809 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.381812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.381866 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.381948 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.382813 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.383395 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.384553 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.384771 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.384849 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.387546 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.387549 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.387551 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.387573 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.389192 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.389743 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.389747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.389749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.389830 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.390175 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.390178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.390180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.390360 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.390469 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.390935 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.391051 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 18:43:43.391992 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.379406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59048 (local address 127.10.174.252:34455)
0807 18:43:43.379849 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.379864 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.379899 (+ 35us) server_negotiation.cc:407] Connection header received
0807 18:43:43.380723 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.380767 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.381203 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.381573 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.382438 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.383645 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.384438 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.384869 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.385034 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.387984 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.387989 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.387997 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.388018 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.389542 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.389995 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.390000 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.390001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.390075 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.390358 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.390362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.390364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.390702 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.390907 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.391087 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.391410 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":294,"thread_start_us":116,"threads_started":1}
I20260807 18:43:43.391996 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.380984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60310)
0807 18:43:43.381392 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.381458 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.381648 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.382048 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.382052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.382404 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.382672 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.382685 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.383534 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.383537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.384419 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.384430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.384912 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.384918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.385039 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.385757 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.385771 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.387335 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.389314 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.389325 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.389333 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.389637 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.389931 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.389934 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.389936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.390070 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.390467 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.390473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.390709 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.390877 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.391162 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":49,"spinlock_wait_cycles":3712,"thread_start_us":164,"threads_started":1}
I20260807 18:43:43.393179 18082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.252@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
I20260807 18:43:43.400931 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.393619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49192)
0807 18:43:43.393764 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.393778 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.393844 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.394238 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.394240 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.394396 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.394476 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.394481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.395435 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.395438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.395960 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.395967 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.396456 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.396460 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.396564 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.396917 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.396927 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.398055 (+ 1128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.399816 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.399818 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.399819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.399996 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.400231 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.400233 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.400234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.400307 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.400614 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.400616 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.400678 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.400751 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.400835 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 18:43:43.401047 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.393732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.10.174.253:39887)
0807 18:43:43.394041 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.394044 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.394055 (+ 11us) server_negotiation.cc:407] Connection header received
0807 18:43:43.394090 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.394091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.394127 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.394223 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.394599 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.395270 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.396079 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.396344 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.396456 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.398189 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.398192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.398193 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.398217 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.399726 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.400074 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.400076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.400077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.400148 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.400379 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.400382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.400383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.400539 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.400610 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.400808 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.400901 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":124,"threads_started":1}
I20260807 18:43:43.401690 18082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.252@KRBTEST.COM for oryx/127.10.174.252@KRBTEST.COM
I20260807 18:43:43.408918 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.402107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59062)
0807 18:43:43.402268 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.402284 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.402392 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.402621 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.402624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.402789 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.402842 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.402847 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.403581 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.403585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.404037 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.404044 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.404511 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.404515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.404609 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.404963 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.404974 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.406091 (+ 1117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.407515 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.407521 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.407523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.407702 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.407955 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.407959 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.407961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.408036 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.408402 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.408405 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.408481 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.408600 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.408719 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":19}
I20260807 18:43:43.408918 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.402152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59062 (local address 127.10.174.252:34455)
0807 18:43:43.402268 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.402273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.402354 (+ 81us) server_negotiation.cc:407] Connection header received
0807 18:43:43.402482 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.402484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.402525 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.402619 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.402946 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.403473 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.404152 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.404381 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.404514 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.406215 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.406218 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.406221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.406247 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.407419 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.407792 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.407798 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.407800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.407870 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.408125 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.408131 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.408132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.408300 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.408401 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.408676 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.408759 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":62}
I20260807 18:43:43.412177 18082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Bootstrap starting.
I20260807 18:43:43.414461 18082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:43.415226 18082 log.cc:824] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:43.417037 18082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: No bootstrap required, opened a new log
I20260807 18:43:43.420164 18082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } }
I20260807 18:43:43.420339 18082 raft_consensus.cc:374] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:43.420377 18082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 394ad5f93504429faac6a5c1c4e70f46, State: Initialized, Role: FOLLOWER
I20260807 18:43:43.420711 18082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } }
I20260807 18:43:43.421099 18088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } } }
I20260807 18:43:43.421275 18088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:43.421805 18082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 18:43:43.426761 18099 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:43.426856 18099 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:43.430289 17920 master_runner.cc:428] Detected that this master 394ad5f93504429faac6a5c1c4e70f46 is joining an existing cluster
I20260807 18:43:43.430341 17920 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.174.252:34455
I20260807 18:43:43.442930 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.432542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59070 (local address 127.10.174.252:34455)
0807 18:43:43.432714 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.432718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.433275 (+ 557us) server_negotiation.cc:407] Connection header received
0807 18:43:43.433435 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.433438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.433476 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.433527 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.434407 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.435242 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.437675 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.438039 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.438146 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.439533 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.439537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.439539 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.439563 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.441325 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.441758 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.441763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.441768 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.441852 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.442133 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.442136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.442138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.442304 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.442406 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.442653 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.442791 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":103}
I20260807 18:43:43.442943 18107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.432805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59070)
0807 18:43:43.433193 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.433207 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.433340 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.433702 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.433707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.433955 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.434280 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.434285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.436399 (+ 2114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.436404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.437543 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.437555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.438176 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.438180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.438267 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.438914 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.438931 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.439405 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.441422 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.441428 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.441431 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.441678 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.441952 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.441955 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.441957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.442041 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.442406 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.442409 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.442497 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.442598 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.442740 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":148,"spinlock_wait_cycles":4864,"thread_start_us":84,"threads_started":1}
I20260807 18:43:43.445364 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17403
I20260807 18:43:43.456009 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:39873
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:35247
--webserver_port=43587
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:43:43.464463 18105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.432463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60320)
0807 18:43:43.432738 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.432755 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.432846 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.433636 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.433642 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.433957 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.434277 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.434285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.436320 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.436323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.437936 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.437944 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.438532 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.438536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.438628 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.459862 (+ 21234us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.459880 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.460411 (+ 531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.462543 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.462546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.462548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.462808 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.463123 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.463127 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.463129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.463256 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.463822 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.463825 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.463922 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.464030 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.464202 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":152,"spinlock_wait_cycles":2688,"thread_start_us":121,"threads_started":1}
I20260807 18:43:43.465183 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.433311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.10.174.254:35247)
0807 18:43:43.433422 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.433426 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.433440 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:43.433486 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.433488 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.433524 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.433592 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.435378 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.436183 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.438057 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.438413 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.438529 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.460602 (+ 22073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.460606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.460609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.460640 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.462415 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.462924 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.462928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.462930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.463020 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.463403 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.463411 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.463416 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.463672 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.463774 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.464839 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.464966 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 18:43:43.468288 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.433351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49196 (local address 127.10.174.253:39887)
0807 18:43:43.433471 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.433475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.439552 (+ 6077us) server_negotiation.cc:407] Connection header received
0807 18:43:43.439735 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.439739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.439804 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.439881 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.459977 (+ 20096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.460781 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.462103 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.462487 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.462563 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.464177 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.464181 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.464184 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.464212 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.465920 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.466413 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.466418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.466423 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.466506 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.466855 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.466859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.466860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.467512 (+ 652us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.467610 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.468002 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.468133 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:43.468842 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.432898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49196)
0807 18:43:43.439468 (+ 6570us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.439481 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.439613 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.440026 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.440031 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.459563 (+ 19532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.459771 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.459789 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.460953 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.460957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.461953 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.461965 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.462984 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.462988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.463094 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.463600 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.463614 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.464032 (+ 418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.466058 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.466061 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.466063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.466297 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.466616 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.466619 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.466621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.466717 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.467684 (+ 967us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.467689 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.467793 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.468489 (+ 696us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.468675 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6503,"thread_start_us":129,"threads_started":1}
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128221, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.254@KRBTEST.COM for oryx/127.10.174.252@KRBTEST.COM
I20260807 18:43:43.477150 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.469355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59080 (local address 127.10.174.252:34455)
0807 18:43:43.469463 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.469468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.469479 (+ 11us) server_negotiation.cc:407] Connection header received
0807 18:43:43.469544 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.469546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.469596 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.469681 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.470244 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.470776 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.471633 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.471846 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.471956 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.474085 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.474088 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.474093 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.474120 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.475552 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.475975 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.475979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.475981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.476059 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.476346 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.476352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.476353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.476522 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.476630 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.476892 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.477000 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:43:43.477150 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.469094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59080)
0807 18:43:43.469232 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.469248 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.469326 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.469809 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.469812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.470004 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.470108 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.470115 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.470885 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.470890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.471515 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.471524 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.471961 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.471965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.472065 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.472541 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.472559 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.473926 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.475664 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.475669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.475674 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.475875 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.476155 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.476165 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.476167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.476254 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.476623 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.476626 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.476729 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.476837 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.476989 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 18:43:43.478435 17339 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.174.252:34455: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46"
member_type: NON_VOTER
last_known_addr {
host: "127.10.174.252"
port: 34455
}
attrs {
promote: true
}
}
dest_uuid: "02fa2654bab74c528745865c14b78eaf"
cas_config_opid_index: 5
I20260807 18:43:43.479017 17339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } }
I20260807 18:43:43.480260 17917 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.481685 17917 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.174.252:34455
I20260807 18:43:43.481858 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.481984 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:43.482782 18055 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:43.483201 17920 master.cc:537] Master@127.10.174.252:34455 shutting down...
I20260807 18:43:43.484409 18055 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Refusing update from remote peer 02fa2654bab74c528745865c14b78eaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 18:43:43.485070 17917 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 18:43:43.487090 17326 consensus_peers.cc:487] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf -> Peer 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252:34455): Couldn't send request to peer 394ad5f93504429faac6a5c1c4e70f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 18:43:43.488286 17920 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:43.488651 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.482839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49198 (local address 127.10.174.253:39887)
0807 18:43:43.482972 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.482978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.483632 (+ 654us) server_negotiation.cc:407] Connection header received
0807 18:43:43.483823 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.483829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.483906 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.483977 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:43.484418 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.485141 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.486720 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.487437 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.487530 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.487681 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.488427 (+ 746us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.488507 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:43:43.489048 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.482528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49198)
0807 18:43:43.483554 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.483570 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.483700 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.484152 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.484167 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.484188 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:43.484278 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.484284 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.485299 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.485303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.486577 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.486587 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.487822 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.487826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.488238 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.488289 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.488837 (+ 548us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.488935 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":950}
I20260807 18:43:43.489289 17920 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:43.489575 17968 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 LEARNER]: Refusing update from remote peer 02fa2654bab74c528745865c14b78eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 18:43:43.489706 17920 tablet_replica.cc:330] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: stopping tablet replica
I20260807 18:43:43.489995 17917 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 18:43:43.491882 17968 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.493965 18001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02fa2654bab74c528745865c14b78eaf. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.494095 18001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: LEARNER
I20260807 18:43:43.494211 18001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.494295 18001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: LEARNER
I20260807 18:43:43.495342 17920 master.cc:552] Master@127.10.174.252:34455 shutdown complete.
I20260807 18:43:43.495410 17920 master_runner.cc:305] Clearing existing system tablet
I20260807 18:43:43.495643 17920 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.495721 17920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.496762 17920 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 18:43:43.497592 18115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.497828 17920 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.497982 17920 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:43.498019 17920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
uuid: "394ad5f93504429faac6a5c1c4e70f46"
format_stamp: "Formatted at 2026-08-07 18:43:43 on dist-test-slave-07c2"
server_key: "559232d642679720ca3d601469b4e58e"
server_key_iv: "c76487304e36c42fb859ed5fa1a5734a"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.499730 17920 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:43.501670 17920 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 18:43:43.501775 17920 log.cc:1196] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 18:43:43.502014 17920 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Deleting consensus metadata
I20260807 18:43:43.502197 17920 master_runner.cc:315] Copying system tablet from 127.10.174.254:35247
I20260807 18:43:43.503343 17920 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: tablet copy: Beginning tablet copy session from remote peer at address 127.10.174.254:35247
I20260807 18:43:43.508929 17917 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: attempting to promote NON_VOTER 225fee289ca44730ba3a74e27dbbf1df to VOTER
I20260807 18:43:43.509502 17917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } }
I20260807 18:43:43.511332 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.510640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59082)
0807 18:43:43.511134 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.511218 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:34455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408}
I20260807 18:43:43.511932 17968 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 LEARNER]: Refusing update from remote peer 02fa2654bab74c528745865c14b78eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 18:43:43.512758 17918 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 18:43:43.513535 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.513292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59098)
0807 18:43:43.513420 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.513472 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:34455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 18:43:43.514006 18121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.503886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60332)
0807 18:43:43.504222 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.504234 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.504365 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.504643 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.504646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.505206 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.505367 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.505376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.506281 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.506287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.507158 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.507168 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.507886 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.507890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.507989 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.508787 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.508803 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.509335 (+ 532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.511740 (+ 2405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.511745 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.511748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.511994 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.512406 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.512408 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.512410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.512504 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.513072 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.513075 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.513188 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.513568 (+ 380us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.513810 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":86,"threads_started":1}
W20260807 18:43:43.514364 17326 consensus_peers.cc:487] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf -> Peer 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252:34455): Couldn't send request to peer 394ad5f93504429faac6a5c1c4e70f46. Status: Network error: Client connection negotiation failed: client connection to 127.10.174.252:34455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:43:43.514565 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.503961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60332 (local address 127.10.174.254:35247)
0807 18:43:43.504096 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.504100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.504319 (+ 219us) server_negotiation.cc:407] Connection header received
0807 18:43:43.504475 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.504478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.504533 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.504620 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.505516 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.506170 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.507282 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.507646 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.507750 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.509507 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.509512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.509519 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.509548 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.511528 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.512188 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.512193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.512195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.512283 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.512640 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.512643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.512645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.512873 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.512946 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.513380 (+ 434us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.513491 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:43:43.514882 17361 tablet_copy_service.cc:140] P 02fa2654bab74c528745865c14b78eaf: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 394ad5f93504429faac6a5c1c4e70f46 ({username='oryx', principal='oryx/127.10.174.252@KRBTEST.COM'} at 127.0.0.1:60332)
I20260807 18:43:43.514971 17361 tablet_copy_service.cc:161] P 02fa2654bab74c528745865c14b78eaf: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 394ad5f93504429faac6a5c1c4e70f46 at {username='oryx', principal='oryx/127.10.174.252@KRBTEST.COM'} at 127.0.0.1:60332: session id = 394ad5f93504429faac6a5c1c4e70f46-00000000000000000000000000000000
I20260807 18:43:43.516094 17361 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 18:43:43.516094 17918 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 225fee289ca44730ba3a74e27dbbf1df (127.10.174.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.516570 17968 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 225fee289ca44730ba3a74e27dbbf1df (127.10.174.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.517912 17918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.518015 17918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:43.518074 18113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.518195 18113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:43.518158 17918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.518239 17918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:43.519557 17920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 18:43:43.521358 17920 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: tablet copy: Starting download of 0 data blocks...
I20260807 18:43:43.521628 17920 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: tablet copy: Starting download of 1 WAL segments...
I20260807 18:43:43.523209 17920 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 18:43:43.524950 17361 tablet_copy_service.cc:342] P 02fa2654bab74c528745865c14b78eaf: Request end of tablet copy session 394ad5f93504429faac6a5c1c4e70f46-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.174.252@KRBTEST.COM'} at 127.0.0.1:60332
I20260807 18:43:43.525045 17361 tablet_copy_service.cc:433] P 02fa2654bab74c528745865c14b78eaf: ending tablet copy session 394ad5f93504429faac6a5c1c4e70f46-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 394ad5f93504429faac6a5c1c4e70f46
I20260807 18:43:43.532159 17920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:43.533711 18122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.533823 18123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.534067 17920 server_base.cc:1034] running on GCE node
W20260807 18:43:43.534474 18125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.534723 17920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:43.535077 17920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:43.536216 17920 hybrid_clock.cc:648] HybridClock initialized: now 1786128223536206 us; error 26 us; skew 500 ppm
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:43.537734 17920 init.cc:377] Logged in from keytab as oryx/127.10.174.252@KRBTEST.COM (short username oryx)
I20260807 18:43:43.538224 17920 webserver.cc:460] Webserver started at http://127.10.174.252:37873/ using document root <none> and password file <none>
I20260807 18:43:43.538431 17920 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.538483 17920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.539731 17920 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:43.540803 18132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.541074 17920 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 18:43:43.541216 17920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
uuid: "394ad5f93504429faac6a5c1c4e70f46"
format_stamp: "Formatted at 2026-08-07 18:43:43 on dist-test-slave-07c2"
server_key: "559232d642679720ca3d601469b4e58e"
server_key_iv: "c76487304e36c42fb859ed5fa1a5734a"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.541325 17920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.557878 17920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:43.560376 17920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:43.565557 17920 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.252:34455
I20260807 18:43:43.565994 18185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.252:34455 every 8 connection(s)
I20260807 18:43:43.566324 17920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
I20260807 18:43:43.568035 18186 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:43:43.568881 18186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Bootstrap starting.
I20260807 18:43:43.584542 18186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260807 18:43:43.584913 18186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: Bootstrap complete.
I20260807 18:43:43.586061 18186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } }
I20260807 18:43:43.586544 18186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 394ad5f93504429faac6a5c1c4e70f46, State: Initialized, Role: LEARNER
I20260807 18:43:43.586755 18186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } }
I20260807 18:43:43.587102 18189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: NON_VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: true } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.587275 18186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:43.587425 18189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:43:43.590195 18201 catalog_manager.cc:1259] Loaded cluster ID: a45c5784cc2b46fba8a11ecf70bc1df1
I20260807 18:43:43.590320 18201 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: loading cluster ID for follower catalog manager: success
I20260807 18:43:43.592159 18201 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: acquiring CA information for follower catalog manager: success
I20260807 18:43:43.593310 18201 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 18:43:43.626094 18109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:43.626390 18109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:43.626447 18109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:43.632483 18109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:43.632557 18109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:43.632648 18109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:43.640537 18109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:39873
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=43587
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:43.642017 18109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:43.643555 18109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:43:43.648360 17813 heartbeater.cc:503] Master 127.10.174.254:35247 was elected leader, sending a full tablet report...
W20260807 18:43:43.653939 18207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.653975 18206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.654013 18109 server_base.cc:1034] running on GCE node
W20260807 18:43:43.654438 18209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.654817 18109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:43.655478 18109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:43.656661 18109 hybrid_clock.cc:648] HybridClock initialized: now 1786128223656651 us; error 28 us; skew 500 ppm
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:43.659636 18109 init.cc:377] Logged in from keytab as oryx/127.10.174.193@KRBTEST.COM (short username oryx)
I20260807 18:43:43.660609 18109 webserver.cc:460] Webserver started at http://127.10.174.193:43587/ using document root <none> and password file <none>
I20260807 18:43:43.661089 18109 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.661160 18109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.664826 18109 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:43.666647 18216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.667920 18109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:43.668011 18109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "e8aeb11509944b308a29bb6317067066"
format_stamp: "Formatted at 2026-08-07 18:43:41 on dist-test-slave-07c2"
server_key: "816af9887e1cbdd9200b1225fa350f03"
server_key_iv: "036a2f7c404b6486f86c17d7cef37b36"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.668493 18109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.686102 18109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:43.689661 18109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:43.689842 18109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:43.690392 18109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:43.691186 18109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:43.691241 18109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.691329 18109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:43.691366 18109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.702346 18109 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:39873
I20260807 18:43:43.702373 18330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:39873 every 8 connection(s)
I20260807 18:43:43.703279 18109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:43.704528 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 18109
I20260807 18:43:43.704747 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17542
I20260807 18:43:43.713992 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:44815
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:35247
--webserver_port=43557
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.252@KRBTEST.COM
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
I20260807 18:43:43.723057 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.709387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:41431 (local address 127.10.174.253:39887)
0807 18:43:43.709521 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.709528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.709590 (+ 62us) server_negotiation.cc:407] Connection header received
0807 18:43:43.709793 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.709796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.709850 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.709902 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.710470 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.711245 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713231 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.713585 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713668 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.718319 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.718323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.718326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.718352 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.720877 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721439 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.721443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.721445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.721523 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721864 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.721867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.721869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.722376 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.722474 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.722795 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.722910 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:43.723062 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.705303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:34157 (local address 127.10.174.254:35247)
0807 18:43:43.705432 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.705437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.707055 (+ 1618us) server_negotiation.cc:407] Connection header received
0807 18:43:43.708190 (+ 1135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.708197 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.708273 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.708334 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.710083 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.710991 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713210 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.713606 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713684 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.718416 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.718423 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.718429 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.718465 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.720368 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721075 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.721081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.721084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.721183 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721656 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.721661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.721665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.721918 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.722019 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.722696 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.722834 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:43:43.723922 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.705795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:49197 (local address 127.10.174.252:34455)
0807 18:43:43.708041 (+ 2246us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.708046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.708064 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:43:43.708163 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.708166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.708222 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.708338 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.710064 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.711203 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713239 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.713596 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713681 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.718319 (+ 4638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.718323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.718326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.718352 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.720813 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721428 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.721431 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.721433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.721523 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721863 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.721867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.721869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.722067 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.722178 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.723635 (+ 1457us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.723774 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2162,"thread_start_us":91,"threads_started":1}
I20260807 18:43:43.724387 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.709103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.10.174.193:41431)
0807 18:43:43.709503 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.709517 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.709658 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.710037 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.710040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.710219 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.710330 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.710337 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.711494 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.711496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.713089 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.713100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.713834 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.714083 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.715063 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.715078 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.718126 (+ 3048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.720980 (+ 2854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.720985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.720989 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.721327 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.721639 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721643 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.721644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.721752 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.722518 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.722521 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.722607 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.723473 (+ 866us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.723615 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":450,"spinlock_wait_cycles":12800,"thread_start_us":147,"threads_started":1}
I20260807 18:43:43.724654 18335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.705684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:34157)
0807 18:43:43.706941 (+ 1257us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.706953 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.707944 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.708510 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.708516 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.709081 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.709913 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.709932 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.711217 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.711223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.713070 (+ 1847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.713084 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.713865 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.714086 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.714791 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.714817 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.718225 (+ 3408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.720517 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.720526 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.720541 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.720941 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.721326 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.721336 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.721520 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.722097 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.722104 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.722412 (+ 308us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.723374 (+ 962us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.723534 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1198,"mutex_wait_us":661,"spinlock_wait_cycles":93184,"thread_start_us":155,"threads_started":1}
I20260807 18:43:43.724400 18336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.705587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.10.174.193:49197)
0807 18:43:43.706791 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.706847 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.707960 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.708504 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.708510 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.709072 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.709910 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.709929 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.711380 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.711386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.713089 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.713100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.713834 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.713837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.714341 (+ 504us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.714945 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.714962 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.718126 (+ 3164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.720946 (+ 2820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.720949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.720952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.721309 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.721633 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.721636 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.721638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.721751 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.722169 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.722172 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.722400 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.722581 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.722894 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"mutex_wait_us":440,"spinlock_wait_cycles":11392,"thread_start_us":125,"threads_started":1}
I20260807 18:43:43.725865 18332 heartbeater.cc:347] Connected to a master server at 127.10.174.252:34455
I20260807 18:43:43.725853 18333 heartbeater.cc:347] Connected to a master server at 127.10.174.253:39887
I20260807 18:43:43.725853 18331 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35247
I20260807 18:43:43.726104 18332 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:43.726104 18331 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:43.726646 18331 heartbeater.cc:511] Master 127.10.174.254:35247 requested a full tablet report, sending...
I20260807 18:43:43.726650 18332 heartbeater.cc:511] Master 127.10.174.252:34455 requested a full tablet report, sending...
I20260807 18:43:43.726106 18333 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:43.726928 18333 heartbeater.cc:511] Master 127.10.174.253:39887 requested a full tablet report, sending...
I20260807 18:43:43.728195 17339 ts_manager.cc:194] Re-registered known tserver with Master: e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873)
I20260807 18:43:43.728204 18150 ts_manager.cc:194] Registered new tserver with Master: e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873)
I20260807 18:43:43.728950 17339 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:34157
I20260807 18:43:43.729169 17958 ts_manager.cc:194] Registered new tserver with Master: e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873)
W20260807 18:43:43.824633 18339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:43.824860 18339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:43.824900 18339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:43.829363 18339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:43.829416 18339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:43.829509 18339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:43.834527 18339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:44815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=43557
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:43.835533 18339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:43.836488 18339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:43.845835 18345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.845876 18346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:43.845834 18348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:43.846161 18339 server_base.cc:1034] running on GCE node
I20260807 18:43:43.846556 18339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:43.847149 18339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:43.848340 18339 hybrid_clock.cc:648] HybridClock initialized: now 1786128223848330 us; error 31 us; skew 500 ppm
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:43.851096 18339 init.cc:377] Logged in from keytab as oryx/127.10.174.194@KRBTEST.COM (short username oryx)
I20260807 18:43:43.851948 18339 webserver.cc:460] Webserver started at http://127.10.174.194:43557/ using document root <none> and password file <none>
I20260807 18:43:43.852432 18339 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:43.852502 18339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:43.856225 18339 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 18:43:43.858193 18355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.859423 18339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:43:43.859558 18339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "bee4edfa7e7761ee7aaa25693dd61557"
server_key_iv: "a719b05d0eca72dc03a68192e6c4acfe"
server_key_version: "encryptionkey@0"
I20260807 18:43:43.860194 18339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:43.889490 18339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:43.892944 18339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:43.893177 18339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:43.893375 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.889734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59100 (local address 127.10.174.252:34455)
0807 18:43:43.889865 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.889868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.889925 (+ 57us) server_negotiation.cc:407] Connection header received
0807 18:43:43.890112 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.890115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.890192 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.890301 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:43.890561 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.891086 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.892359 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.892821 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.892951 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.893087 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.893173 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.893251 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:43.893375 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.889647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59100)
0807 18:43:43.889847 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.889863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.889984 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.890324 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.890327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.890346 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:43.890451 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.890457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.891207 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.891212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.892230 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.892242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.892952 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.892956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.893044 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.893067 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.893154 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.893237 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260807 18:43:43.893882 18339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:43.894068 18160 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 18:43:43.894447 18160 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 LEARNER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 225fee289ca44730ba3a74e27dbbf1df (127.10.174.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.894904 18339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:43.894976 18339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.895044 18339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:43.895076 18339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:43.896925 18364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.897065 18364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:43:43.897019 18189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02fa2654bab74c528745865c14b78eaf. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:43.897162 18189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: LEARNER
I20260807 18:43:43.904534 18339 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44815
I20260807 18:43:43.904598 18472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44815 every 8 connection(s)
I20260807 18:43:43.905540 18339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:43.911259 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 18339
I20260807 18:43:43.911459 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17680
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.252@KRBTEST.COM
I20260807 18:43:43.922410 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.909170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:40953 (local address 127.10.174.253:39887)
0807 18:43:43.909303 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.909307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.909448 (+ 141us) server_negotiation.cc:407] Connection header received
0807 18:43:43.909921 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.909924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.909979 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.910081 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.913372 (+ 3291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.913887 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.915005 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.915233 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.915430 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.918170 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.918176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.918181 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.918212 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.920128 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.920684 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.920688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.920690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.920778 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.921121 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.921125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.921127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.921346 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.921453 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.922088 (+ 635us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.922218 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:43:43.923020 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:45327
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:35247
--webserver_port=38851
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:43:43.923321 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.909045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.10.174.194:40953)
0807 18:43:43.909349 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.909370 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.909720 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.910288 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.910296 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.910789 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.913222 (+ 2433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.913239 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.914028 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.914036 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.914878 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.914886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.915461 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.915465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.915632 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.916221 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.916237 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.917991 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.920254 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.920259 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.920274 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.920523 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.920872 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.920876 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.920879 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.921023 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.921463 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.921469 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.921784 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.921993 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.922303 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":79,"thread_start_us":143,"threads_started":1}
I20260807 18:43:43.924891 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.907539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:60489 (local address 127.10.174.252:34455)
0807 18:43:43.907646 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.907653 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.908703 (+ 1050us) server_negotiation.cc:407] Connection header received
0807 18:43:43.909987 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.909990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.910041 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.910092 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.916630 (+ 6538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.917240 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.918209 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.918551 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.918665 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.921054 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.921058 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.921061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.921087 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.922758 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.923390 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.923396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.923400 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.923490 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.923832 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.923838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.923843 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.924079 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.924165 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.924529 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.924668 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 18:43:43.925773 18477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.907980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.10.174.194:60489)
0807 18:43:43.908514 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.908591 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.909714 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.910288 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.910297 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.910812 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.916487 (+ 5675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.916499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.917363 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.917369 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.918035 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.918044 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.918665 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.918674 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.918778 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.919278 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.919332 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.920905 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.922988 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.922991 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.922993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.923244 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.923609 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.923614 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.923619 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.923712 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.924229 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.924234 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.924336 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.925102 (+ 766us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.925238 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":187,"spinlock_wait_cycles":31616,"thread_start_us":138,"threads_started":1}
I20260807 18:43:43.926432 18474 heartbeater.cc:347] Connected to a master server at 127.10.174.252:34455
I20260807 18:43:43.926581 18475 heartbeater.cc:347] Connected to a master server at 127.10.174.253:39887
I20260807 18:43:43.926666 18475 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:43.926669 18474 heartbeater.cc:464] Registering TS with master...
Aug 07 18:43:43 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128223, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:43.927261 18474 heartbeater.cc:511] Master 127.10.174.252:34455 requested a full tablet report, sending...
I20260807 18:43:43.928097 18475 heartbeater.cc:511] Master 127.10.174.253:39887 requested a full tablet report, sending...
I20260807 18:43:43.928508 18150 ts_manager.cc:194] Registered new tserver with Master: 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815)
I20260807 18:43:43.928892 17958 ts_manager.cc:194] Registered new tserver with Master: 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815)
I20260807 18:43:43.931034 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.907406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:43573 (local address 127.10.174.254:35247)
0807 18:43:43.907530 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:43.907535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:43.908695 (+ 1160us) server_negotiation.cc:407] Connection header received
0807 18:43:43.909945 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:43.909952 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:43.910008 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:43.910062 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:43.922777 (+ 12715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.923553 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.924439 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.924746 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.924865 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.927455 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:43.927459 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:43.927461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:43.927487 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:43.929368 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.929880 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.929882 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.929883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.929957 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:43.930273 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:43.930275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:43.930276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:43.930435 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:43.930506 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:43.930837 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 18:43:43.930928 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:43:43.931210 18478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:43.907980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:43573)
0807 18:43:43.908514 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:43.908591 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:43.909714 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:43.910288 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:43.910297 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:43.910771 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:43.922620 (+ 11849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.922630 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.923701 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.923704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.924309 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:43.924318 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:43.925012 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:43.925017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:43.925129 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:43.925731 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:43.925747 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:43.927245 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:43.929472 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.929479 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.929483 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.929768 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.930051 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:43.930056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:43.930059 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:43.930166 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:43.930530 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:43.930536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:43.930653 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 18:43:43.930780 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 18:43:43.930945 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":174,"spinlock_wait_cycles":89600,"thread_start_us":161,"threads_started":1}
I20260807 18:43:43.931934 18473 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35247
I20260807 18:43:43.932039 18473 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:43.932260 18473 heartbeater.cc:511] Master 127.10.174.254:35247 requested a full tablet report, sending...
I20260807 18:43:43.932902 17339 ts_manager.cc:194] Re-registered known tserver with Master: 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815)
I20260807 18:43:43.933449 17339 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:43573
W20260807 18:43:44.036512 18480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:44.036742 18480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:44.036788 18480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:44.040879 18480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:44.040930 18480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:44.040985 18480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:44.046293 18480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:45327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=38851
--tserver_master_addrs=127.10.174.254:35247,127.10.174.253:39887,127.10.174.252:34455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:44.047183 18480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:44.048134 18480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:44.057600 18485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:44.057607 18488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:44.057617 18486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:44.057801 18480 server_base.cc:1034] running on GCE node
I20260807 18:43:44.058384 18480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:44.058990 18480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:44.060170 18480 hybrid_clock.cc:648] HybridClock initialized: now 1786128224060156 us; error 34 us; skew 500 ppm
Aug 07 18:43:44 dist-test-slave-07c2 krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128224, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:44.062981 18480 init.cc:377] Logged in from keytab as oryx/127.10.174.195@KRBTEST.COM (short username oryx)
I20260807 18:43:44.063941 18480 webserver.cc:460] Webserver started at http://127.10.174.195:38851/ using document root <none> and password file <none>
I20260807 18:43:44.064527 18480 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:44.064632 18480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:44.068400 18480 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 18:43:44.070681 18497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:44.071944 18480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:44.072083 18480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "ed82c5042ddd41808def79d8e43743a2"
format_stamp: "Formatted at 2026-08-07 18:43:42 on dist-test-slave-07c2"
server_key: "033902f3376e18608c8f242c331e5655"
server_key_iv: "f2b1ad5bf7af749f1c4497ce5e06ba46"
server_key_version: "encryptionkey@0"
I20260807 18:43:44.072708 18480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:44.085517 18480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:44.089257 18480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:44.089463 18480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:44.090234 18480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:44.091125 18480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:44.091173 18480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:44.091212 18480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:44.091234 18480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:44.099736 18480 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:45327
I20260807 18:43:44.099828 18612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:45327 every 8 connection(s)
I20260807 18:43:44.100762 18480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:44.101207 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 18480
Aug 07 18:43:44 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128224, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.252@KRBTEST.COM
Aug 07 18:43:44 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128224, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.253@KRBTEST.COM
I20260807 18:43:44.115278 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.103614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60348 (local address 127.10.174.254:35247)
0807 18:43:44.103734 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.103738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.104073 (+ 335us) server_negotiation.cc:407] Connection header received
0807 18:43:44.104518 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.104522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.104604 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.104662 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.105735 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.106542 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.107840 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.108156 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.108263 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.110097 (+ 1834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.110103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.110107 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.110131 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.112453 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.113644 (+ 1191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.113648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.113650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.113742 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.114081 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.114085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.114087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.114301 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.114427 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.114983 (+ 556us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.115107 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 18:43:44 dist-test-slave-07c2 krb5kdc[17293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128224, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:44.120019 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.103310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.10.174.252:34455)
0807 18:43:44.106743 (+ 3433us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.106761 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.106772 (+ 11us) server_negotiation.cc:407] Connection header received
0807 18:43:44.106807 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.106810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.106852 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.107772 (+ 920us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.107876 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.108597 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.109953 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.110348 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.110854 (+ 506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.112349 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.112354 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.112357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.112379 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.116839 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.118079 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.118082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.118084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.118168 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.118508 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.118512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.118513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.118770 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.119582 (+ 812us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.119675 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.119827 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3361,"thread_start_us":71,"threads_started":1}
I20260807 18:43:44.120525 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.102529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:32985 (local address 127.10.174.252:34455)
0807 18:43:44.102689 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.102694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.104716 (+ 2022us) server_negotiation.cc:407] Connection header received
0807 18:43:44.105868 (+ 1152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.105872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.105921 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.105972 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.108023 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.108757 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.110288 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.110605 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.110681 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.115802 (+ 5121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.115806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.115808 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.115834 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.117455 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.118467 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.118472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.118475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.118573 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.118981 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.118984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.118986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.119171 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.119248 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.120267 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.120384 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:43:44.118602 17339 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:43:44.122144 18621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.102933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.10.174.195:32985)
0807 18:43:44.104583 (+ 1650us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.104632 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.105621 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.106226 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.106234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.107556 (+ 1322us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:44.107701 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.107707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.108888 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.108891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.110153 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.110164 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.110856 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.110860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.111047 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.111680 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:44.111701 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:44.115187 (+ 3486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:44.117592 (+ 2405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:44.117599 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:44.117616 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:44.117994 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:44.118706 (+ 712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:44.118709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:44.118711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:44.118874 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:44.119696 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:44.119702 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:44.119993 (+ 291us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.120737 (+ 744us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.121073 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1399,"mutex_wait_us":4,"thread_start_us":156,"threads_started":1}
W20260807 18:43:44.122737 17339 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:44.123621 18614 heartbeater.cc:347] Connected to a master server at 127.10.174.252:34455
I20260807 18:43:44.123831 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.103979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49204 (local address 127.10.174.253:39887)
0807 18:43:44.104109 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.104114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.112221 (+ 8107us) server_negotiation.cc:407] Connection header received
0807 18:43:44.112879 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.112883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.112938 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.112996 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.113954 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.114937 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.117518 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.117817 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.117902 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.120394 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.120398 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.120400 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.120425 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.122015 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.122526 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.122529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.122531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.122611 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.122941 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.122945 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.122946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.123120 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.123254 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.123523 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.123649 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:43:44.123854 18614 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:44.124440 18614 heartbeater.cc:511] Master 127.10.174.252:34455 requested a full tablet report, sending...
I20260807 18:43:44.125604 18150 ts_manager.cc:194] Registered new tserver with Master: ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327)
I20260807 18:43:44.127019 18626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.104491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.10.174.195:35557)
0807 18:43:44.106233 (+ 1742us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.106246 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.106344 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.106747 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.106750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.106908 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:44.107512 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.107534 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.108683 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.108686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.110381 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.110390 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.111149 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.111152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.111266 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.112759 (+ 1493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:44.112782 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:44.116350 (+ 3568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:44.125482 (+ 9132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:44.125485 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:44.125487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:44.125685 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:44.125967 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:44.125972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:44.125973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:44.126060 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:44.126490 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:44.126493 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:44.126585 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.126693 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.126841 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1683,"mutex_wait_us":124,"thread_start_us":99,"threads_started":1}
I20260807 18:43:44.127019 18629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.104837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:35557 (local address 127.10.174.253:39887)
0807 18:43:44.105083 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.105089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.106428 (+ 1339us) server_negotiation.cc:407] Connection header received
0807 18:43:44.106479 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.106484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.106536 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.106622 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.107689 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.108505 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.110559 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.110946 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.111038 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.116508 (+ 5470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.116512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.116515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.116545 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.125362 (+ 8817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.125786 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.125790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.125791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.125873 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.126167 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.126170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.126171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.126385 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.126498 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.126744 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.126854 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":80,"threads_started":1}
I20260807 18:43:44.127853 18627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.104181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:57093 (local address 127.10.174.254:35247)
0807 18:43:44.105839 (+ 1658us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.105844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.105856 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:43:44.105893 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.105896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.105943 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.106040 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.111433 (+ 5393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.112255 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.114623 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.114991 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.115101 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.123392 (+ 8291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.123399 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.123405 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.123437 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.125546 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.126117 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.126120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.126121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.126219 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.126530 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.126533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.126535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.126773 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.126844 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.127553 (+ 709us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.127698 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1583,"thread_start_us":69,"threads_started":1}
I20260807 18:43:44.127849 18615 heartbeater.cc:347] Connected to a master server at 127.10.174.253:39887
I20260807 18:43:44.127938 18615 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:44.128121 18615 heartbeater.cc:511] Master 127.10.174.253:39887 requested a full tablet report, sending...
I20260807 18:43:44.128639 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.104038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:57093)
0807 18:43:44.105149 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.105164 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.105649 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.106226 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.106234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.106781 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:44.111329 (+ 4548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.111340 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.113121 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.113126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.114525 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.114535 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.115455 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.115461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.115549 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.116146 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:44.116162 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:44.119551 (+ 3389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:44.125736 (+ 6185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:44.125739 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:44.125741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:44.125989 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:44.126338 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:44.126341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:44.126343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:44.126427 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:44.126919 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:44.126921 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:44.127006 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.127473 (+ 467us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.127618 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1022,"mutex_wait_us":3826,"spinlock_wait_cycles":3968,"thread_start_us":136,"threads_started":1}
I20260807 18:43:44.128877 17958 ts_manager.cc:194] Registered new tserver with Master: ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327)
I20260807 18:43:44.129391 18613 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35247
I20260807 18:43:44.129483 18613 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:44.129647 18613 heartbeater.cc:511] Master 127.10.174.254:35247 requested a full tablet report, sending...
I20260807 18:43:44.129673 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: NON_VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: true } } }
I20260807 18:43:44.129803 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:44.132103 17338 ts_manager.cc:194] Re-registered known tserver with Master: ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327)
I20260807 18:43:44.132880 17338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:57093
I20260807 18:43:44.132922 17917 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: attempting to promote NON_VOTER 394ad5f93504429faac6a5c1c4e70f46 to VOTER
I20260807 18:43:44.133368 17917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } }
I20260807 18:43:44.134406 18160 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 LEARNER]: Refusing update from remote peer 02fa2654bab74c528745865c14b78eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 18:43:44.134768 18632 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 18:43:44.135051 17968 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Refusing update from remote peer 02fa2654bab74c528745865c14b78eaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 18:43:44.135535 17917 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 18:43:44.137133 17917 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.138813 18633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.139110 18633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:44.139321 17968 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.140753 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.140923 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:44.141165 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.141357 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:44.140623 18640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.141671 18640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:44.141606 18160 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.143900 18189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "02fa2654bab74c528745865c14b78eaf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:44.144016 18189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:44.150477 17914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.145112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44815 (local address 127.0.0.1:56830)
0807 18:43:44.145425 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.145441 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.145519 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.146280 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.146284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.146302 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:44.146423 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.146430 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.147630 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.147633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.148831 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.148843 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.150071 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.150076 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.150172 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.150197 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.150268 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.150340 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238}
I20260807 18:43:44.150791 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.145418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56830 (local address 127.10.174.194:44815)
0807 18:43:44.145760 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.145775 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.145801 (+ 26us) server_negotiation.cc:407] Connection header received
0807 18:43:44.145890 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.145897 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.146130 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.146315 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:44.146518 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.147510 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.148976 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.149810 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.149930 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.150372 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.150425 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.150512 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":127,"threads_started":1}
I20260807 18:43:44.151055 18643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.145733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45327 (local address 127.0.0.1:49184)
0807 18:43:44.146361 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.146372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.146441 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.147107 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.147110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.147127 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:44.147218 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.147224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.148353 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.148358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.149104 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.149112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.150669 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.150673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.150769 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.150799 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.150868 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.150933 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":4,"thread_start_us":102,"threads_started":1}
I20260807 18:43:44.151278 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.146138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.10.174.195:45327)
0807 18:43:44.146705 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.146718 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.146739 (+ 21us) server_negotiation.cc:407] Connection header received
0807 18:43:44.146810 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.146814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.146991 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.147135 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:44.147377 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.148229 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.149224 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.150071 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.150181 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.150459 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.150900 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.150993 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":114,"threads_started":1}
I20260807 18:43:44.152216 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.145473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:39873 (local address 127.0.0.1:47556)
0807 18:43:44.146039 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.146054 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.146144 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.147900 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.147903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.147921 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:44.148002 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.148007 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.149620 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.149623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.150705 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.150716 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.151787 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.151790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.151938 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.151962 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.152034 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.152101 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":85,"threads_started":1}
I20260807 18:43:44.153662 18545 tablet_service.cc:1467] Processing CreateTablet for tablet 09ef7809253c446d880007c851a57766 (DEFAULT_TABLE table=test-table [id=a838e46f09894787977c28651ac4a34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:44.153632 18405 tablet_service.cc:1467] Processing CreateTablet for tablet 09ef7809253c446d880007c851a57766 (DEFAULT_TABLE table=test-table [id=a838e46f09894787977c28651ac4a34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:44.154711 18405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ef7809253c446d880007c851a57766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:44.154711 18545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ef7809253c446d880007c851a57766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:44.157959 18644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.145843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47556 (local address 127.10.174.193:39873)
0807 18:43:44.147470 (+ 1627us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.147479 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.147495 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:44.147551 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.147554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.147739 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.148150 (+ 411us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:44.148313 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.149487 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.150866 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.151652 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.157526 (+ 5874us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.157653 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.157716 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.157810 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1522,"thread_start_us":126,"threads_started":1}
I20260807 18:43:44.160821 18264 tablet_service.cc:1467] Processing CreateTablet for tablet 09ef7809253c446d880007c851a57766 (DEFAULT_TABLE table=test-table [id=a838e46f09894787977c28651ac4a34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:44.161306 18646 tablet_bootstrap.cc:492] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Bootstrap starting.
I20260807 18:43:44.161918 18264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ef7809253c446d880007c851a57766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:44.162288 18647 tablet_bootstrap.cc:492] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Bootstrap starting.
I20260807 18:43:44.164362 18646 tablet_bootstrap.cc:654] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:44.164523 18647 tablet_bootstrap.cc:654] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:44.165436 18647 log.cc:824] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:44.165436 18646 log.cc:824] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:44.167495 18646 tablet_bootstrap.cc:492] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: No bootstrap required, opened a new log
I20260807 18:43:44.167495 18647 tablet_bootstrap.cc:492] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: No bootstrap required, opened a new log
I20260807 18:43:44.167682 18646 ts_tablet_manager.cc:1397] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:43:44.167682 18647 ts_tablet_manager.cc:1397] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:43:44.169091 18651 tablet_bootstrap.cc:492] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Bootstrap starting.
I20260807 18:43:44.171276 18651 tablet_bootstrap.cc:654] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:44.172171 18651 log.cc:824] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:44.172887 18646 raft_consensus.cc:348] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.172887 18647 raft_consensus.cc:348] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.173143 18646 raft_consensus.cc:374] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:44.173143 18647 raft_consensus.cc:374] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:44.173202 18647 raft_consensus.cc:729] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7ee7ca2bba4ebb819ea05fc962bd3a, State: Initialized, Role: FOLLOWER
I20260807 18:43:44.173210 18646 raft_consensus.cc:729] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed82c5042ddd41808def79d8e43743a2, State: Initialized, Role: FOLLOWER
I20260807 18:43:44.173656 18647 consensus_queue.cc:260] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.173656 18646 consensus_queue.cc:260] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.174312 18613 heartbeater.cc:503] Master 127.10.174.254:35247 was elected leader, sending a full tablet report...
I20260807 18:43:44.174598 18473 heartbeater.cc:503] Master 127.10.174.254:35247 was elected leader, sending a full tablet report...
I20260807 18:43:44.174608 18647 ts_tablet_manager.cc:1428] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 18:43:44.174154 18651 tablet_bootstrap.cc:492] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: No bootstrap required, opened a new log
I20260807 18:43:44.177109 18646 ts_tablet_manager.cc:1428] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 18:43:44.179798 18651 ts_tablet_manager.cc:1397] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260807 18:43:44.183768 18651 raft_consensus.cc:348] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.184002 18651 raft_consensus.cc:374] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:44.184059 18651 raft_consensus.cc:729] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8aeb11509944b308a29bb6317067066, State: Initialized, Role: FOLLOWER
I20260807 18:43:44.184464 18651 consensus_queue.cc:260] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.185115 18331 heartbeater.cc:503] Master 127.10.174.254:35247 was elected leader, sending a full tablet report...
I20260807 18:43:44.185295 18651 ts_tablet_manager.cc:1428] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260807 18:43:44.207964 18334 tablet.cc:2369] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:44.316414 18655 raft_consensus.cc:482] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:44.316645 18655 raft_consensus.cc:504] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.317838 18655 leader_election.cc:288] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815), ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327)
I20260807 18:43:44.322013 18657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.318493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45327 (local address 127.10.174.193:45945)
0807 18:43:44.318706 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.318720 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.318810 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.319060 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.319063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.319092 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:44.319270 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.319278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.320031 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.320038 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.320905 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.320914 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.321587 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.321590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.321688 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.321735 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.321793 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.321844 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":65,"thread_start_us":71,"threads_started":1}
I20260807 18:43:44.322054 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.318673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:45945 (local address 127.10.174.195:45327)
0807 18:43:44.318820 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.318823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.318837 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:44.318883 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.318885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.318944 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.319023 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:44.319410 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.319894 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.321047 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.321456 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.321582 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.321635 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.321836 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.321925 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 18:43:44.322120 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.318315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43539 (local address 127.10.174.194:44815)
0807 18:43:44.318474 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.318479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.318498 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:43:44.318807 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.318810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.318869 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.318951 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:44.319309 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.319878 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.321079 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.321465 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.321600 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.321651 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.321923 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.321995 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:43:44.322383 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.318099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44815 (local address 127.10.174.193:43539)
0807 18:43:44.318373 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:44.318391 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:44.318490 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:44.318979 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:44.318985 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:44.319010 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:44.319158 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.319164 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.319996 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.320001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.320912 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:44.320921 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.321613 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.321616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:44.321770 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.321815 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 18:43:44.321892 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 18:43:44.321955 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":134,"thread_start_us":118,"threads_started":1}
I20260807 18:43:44.322825 18566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ef7809253c446d880007c851a57766" candidate_uuid: "e8aeb11509944b308a29bb6317067066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed82c5042ddd41808def79d8e43743a2" is_pre_election: true
I20260807 18:43:44.323047 18426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ef7809253c446d880007c851a57766" candidate_uuid: "e8aeb11509944b308a29bb6317067066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" is_pre_election: true
I20260807 18:43:44.323133 18566 raft_consensus.cc:2454] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8aeb11509944b308a29bb6317067066 in term 0.
I20260807 18:43:44.323359 18426 raft_consensus.cc:2454] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8aeb11509944b308a29bb6317067066 in term 0.
I20260807 18:43:44.323709 18217 leader_election.cc:302] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8aeb11509944b308a29bb6317067066, ed82c5042ddd41808def79d8e43743a2; no voters:
I20260807 18:43:44.323931 18655 raft_consensus.cc:2781] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:44.324009 18655 raft_consensus.cc:482] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:44.324039 18655 raft_consensus.cc:3037] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:44.325083 18655 raft_consensus.cc:504] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.325414 18655 leader_election.cc:288] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [CANDIDATE]: Term 1 election: Requested vote from peers 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815), ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327)
I20260807 18:43:44.325742 18426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ef7809253c446d880007c851a57766" candidate_uuid: "e8aeb11509944b308a29bb6317067066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a"
I20260807 18:43:44.325846 18426 raft_consensus.cc:3037] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:44.325874 18566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ef7809253c446d880007c851a57766" candidate_uuid: "e8aeb11509944b308a29bb6317067066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed82c5042ddd41808def79d8e43743a2"
I20260807 18:43:44.326002 18566 raft_consensus.cc:3037] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:44.327028 18426 raft_consensus.cc:2454] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8aeb11509944b308a29bb6317067066 in term 1.
I20260807 18:43:44.327170 18566 raft_consensus.cc:2454] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8aeb11509944b308a29bb6317067066 in term 1.
I20260807 18:43:44.327347 18217 leader_election.cc:302] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7ee7ca2bba4ebb819ea05fc962bd3a, e8aeb11509944b308a29bb6317067066; no voters:
I20260807 18:43:44.327530 18655 raft_consensus.cc:2781] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:44.327713 18655 raft_consensus.cc:686] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 1 LEADER]: Becoming Leader. State: Replica: e8aeb11509944b308a29bb6317067066, State: Running, Role: LEADER
I20260807 18:43:44.328043 18655 consensus_queue.cc:237] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } }
I20260807 18:43:44.331750 17339 catalog_manager.cc:5495] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8aeb11509944b308a29bb6317067066 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "e8aeb11509944b308a29bb6317067066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } health_report { overall_health: UNKNOWN } } }
W20260807 18:43:44.355070 18616 tablet.cc:2369] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:44.381156 18644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.377990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.10.174.193:39873)
0807 18:43:44.378125 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.378129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.378143 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:44.378235 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.378237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.378290 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.378377 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:44.378568 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.379035 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.379829 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.380070 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.380147 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.380395 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:44.380777 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:44.380898 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.380980 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.381058 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:44.386734 18426 raft_consensus.cc:1261] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Refusing update from remote peer e8aeb11509944b308a29bb6317067066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:44.386811 18566 raft_consensus.cc:1261] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Refusing update from remote peer e8aeb11509944b308a29bb6317067066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:44.387506 18655 consensus_queue.cc:1035] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:44.387684 18658 consensus_queue.cc:1035] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:44.395679 18661 mvcc.cc:205] Tried to move back new op lower bound from 7315981207080894464 to 7315981206851862528. Current Snapshot: MvccSnapshot[applied={T|T < 7315981207080894464}]
I20260807 18:43:44.398397 18662 mvcc.cc:205] Tried to move back new op lower bound from 7315981207080894464 to 7315981206851862528. Current Snapshot: MvccSnapshot[applied={T|T < 7315981207080894464}]
I20260807 18:43:44.400537 18663 mvcc.cc:205] Tried to move back new op lower bound from 7315981207080894464 to 7315981206851862528. Current Snapshot: MvccSnapshot[applied={T|T < 7315981207080894464}]
I20260807 18:43:44.405591 17338 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:44.405747 17338 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:44.409374 17338 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 02fa2654bab74c528745865c14b78eaf: Sending DeleteTablet for 3 replicas of tablet 09ef7809253c446d880007c851a57766
I20260807 18:43:44.410099 18264 tablet_service.cc:1514] Processing DeleteTablet for tablet 09ef7809253c446d880007c851a57766 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:44 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:47556
I20260807 18:43:44.410269 18545 tablet_service.cc:1514] Processing DeleteTablet for tablet 09ef7809253c446d880007c851a57766 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:44 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:49184
I20260807 18:43:44.410288 18405 tablet_service.cc:1514] Processing DeleteTablet for tablet 09ef7809253c446d880007c851a57766 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:44 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:56830
I20260807 18:43:44.411511 18671 tablet_replica.cc:330] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: stopping tablet replica
I20260807 18:43:44.411840 18671 raft_consensus.cc:2229] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:44.411870 18670 tablet_replica.cc:330] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: stopping tablet replica
I20260807 18:43:44.412180 18671 raft_consensus.cc:2258] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:44.412207 18670 raft_consensus.cc:2229] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:44.412534 18672 tablet_replica.cc:330] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: stopping tablet replica
I20260807 18:43:44.412571 18670 raft_consensus.cc:2258] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:44.412837 18672 raft_consensus.cc:2229] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:44.413120 18672 raft_consensus.cc:2258] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:44.413725 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17306
I20260807 18:43:44.415517 18672 ts_tablet_manager.cc:1905] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:44.418344 18670 ts_tablet_manager.cc:1905] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:44.419126 18672 ts_tablet_manager.cc:1918] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:44.419274 18672 log.cc:1196] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/09ef7809253c446d880007c851a57766
I20260807 18:43:44.419697 18672 ts_tablet_manager.cc:1939] T 09ef7809253c446d880007c851a57766 P ed82c5042ddd41808def79d8e43743a2: Deleting consensus metadata
W20260807 18:43:44.422317 18499 connection.cc:535] server connection from 127.0.0.1:49184 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:43:44.423489 18671 ts_tablet_manager.cc:1905] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:44.424293 18670 ts_tablet_manager.cc:1918] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:44.424453 18670 log.cc:1196] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/09ef7809253c446d880007c851a57766
I20260807 18:43:44.424860 18670 ts_tablet_manager.cc:1939] T 09ef7809253c446d880007c851a57766 P e8aeb11509944b308a29bb6317067066: Deleting consensus metadata
W20260807 18:43:44.425849 18219 connection.cc:441] server connection from 127.0.0.1:47556 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47556 (request call id 1) could send its response
I20260807 18:43:44.426155 18671 ts_tablet_manager.cc:1918] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:44.426282 18671 log.cc:1196] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/09ef7809253c446d880007c851a57766
I20260807 18:43:44.426604 18671 ts_tablet_manager.cc:1939] T 09ef7809253c446d880007c851a57766 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Deleting consensus metadata
W20260807 18:43:44.427438 18359 connection.cc:441] server connection from 127.0.0.1:56830 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56830 (request call id 1) could send its response
I20260807 18:43:44.431123 18629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.413159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.10.174.253:39887)
0807 18:43:44.413271 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.413275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.417931 (+ 4656us) server_negotiation.cc:407] Connection header received
0807 18:43:44.418715 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.418718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.418770 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.418822 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.422518 (+ 3696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.423391 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.424861 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.425221 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.425291 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.427319 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.427322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.427325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.427369 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.429221 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.429734 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.429741 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.429745 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.429846 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.430131 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.430134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.430136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.430390 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.430529 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.430794 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.430934 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 18:43:44.440163 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.412136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59122 (local address 127.10.174.252:34455)
0807 18:43:44.412253 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.412260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.431077 (+ 18817us) server_negotiation.cc:407] Connection header received
0807 18:43:44.431196 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.431199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.431259 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.431370 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.432232 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.432855 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.433847 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.434190 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.434298 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.435885 (+ 1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.435891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.435893 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.435922 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.438167 (+ 2245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.438674 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.438678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.438679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.438764 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.439087 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.439090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.439095 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.439462 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.439560 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.439885 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.440032 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":41}
I20260807 18:43:44.441197 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.431478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59132 (local address 127.10.174.252:34455)
0807 18:43:44.431618 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.431622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.432222 (+ 600us) server_negotiation.cc:407] Connection header received
0807 18:43:44.432368 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.432370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.432411 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.432490 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.433302 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.433986 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.435153 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.435560 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.435655 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.437164 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.437167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.437169 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.437190 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.438863 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.439357 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.439360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.439362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.439455 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.439759 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.439763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.439766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.440386 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.440887 (+ 501us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.441007 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.441101 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":384,"server-negotiator.queue_time_us":67}
I20260807 18:43:44.446611 18629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:44.435997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49226 (local address 127.10.174.253:39887)
0807 18:43:44.436114 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:44.436118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:44.437505 (+ 1387us) server_negotiation.cc:407] Connection header received
0807 18:43:44.437677 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:44.437680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:44.437721 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:44.437767 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:44.438596 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.439670 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.440955 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:44.441292 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:44.441381 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:44.443765 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:44.443768 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:44.443770 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:44.443789 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:44.445161 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.445597 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.445599 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.445600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.445667 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:44.445920 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:44.445922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:44.445923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:44.446070 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:44.446160 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:44.446388 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 18:43:44.446474 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 18:43:45.399712 18681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.399045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:37641)
0807 18:43:45.399462 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.399573 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":125,"threads_started":1}
W20260807 18:43:45.400056 18331 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:35247 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.400096 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.399597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:53091)
0807 18:43:45.399894 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.399977 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":71,"threads_started":1}
W20260807 18:43:45.400592 18473 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:35247 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.401397 18683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.400977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:38853)
0807 18:43:45.401207 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.401298 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
W20260807 18:43:45.401772 18613 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:35247 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.909865 18684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02fa2654bab74c528745865c14b78eaf)
I20260807 18:43:45.910037 18684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } }
I20260807 18:43:45.911031 18684 leader_election.cc:288] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247), 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252:34455)
I20260807 18:43:45.911099 18685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 02fa2654bab74c528745865c14b78eaf)
I20260807 18:43:45.911314 18685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } }
I20260807 18:43:45.911638 18686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.911149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60834)
0807 18:43:45.911453 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.911530 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":66,"threads_started":1}
W20260807 18:43:45.911913 17942 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.912263 18685 leader_election.cc:288] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247), 225fee289ca44730ba3a74e27dbbf1df (127.10.174.253:39887)
I20260807 18:43:45.912750 18690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.912342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60846)
0807 18:43:45.912591 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.912660 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
W20260807 18:43:45.912899 18135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.912949 18686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.912620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60850)
0807 18:43:45.912771 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.912873 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260807 18:43:45.913089 17942 leader_election.cc:334] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247): Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.913800 18691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.913532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60854)
0807 18:43:45.913644 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.913727 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 18:43:45.913931 18135 leader_election.cc:334] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247): Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.916204 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.911524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:34455 (local address 127.0.0.1:59144)
0807 18:43:45.911788 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.911806 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:45.911948 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:45.912419 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:45.912426 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:45.912451 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:45.912558 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.912569 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.913756 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.913761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.915003 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.915010 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.915777 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.915781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.915869 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.915919 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 18:43:45.916006 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 18:43:45.916079 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":3,"thread_start_us":45,"threads_started":1}
I20260807 18:43:45.916214 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.911359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59144 (local address 127.10.174.252:34455)
0807 18:43:45.911637 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:45.911641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:45.911882 (+ 241us) server_negotiation.cc:407] Connection header received
0807 18:43:45.912099 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:45.912101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:45.912140 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:45.912244 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:45.912693 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.913624 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.915117 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.915654 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.915779 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.915827 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:45.916023 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 18:43:45.916090 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":206,"thread_start_us":57,"threads_started":1}
I20260807 18:43:45.916675 18160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "225fee289ca44730ba3a74e27dbbf1df" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "394ad5f93504429faac6a5c1c4e70f46" is_pre_election: true
I20260807 18:43:45.916867 18160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225fee289ca44730ba3a74e27dbbf1df in term 1.
I20260807 18:43:45.917100 18690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.912680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:39887 (local address 127.0.0.1:49230)
0807 18:43:45.912882 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.912894 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:45.912982 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:45.913794 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:45.913797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:45.913818 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:45.913906 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.913912 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.914889 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.914891 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.915753 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.915762 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.916721 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.916725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.916812 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.916833 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:43:45.916915 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 18:43:45.916978 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":1,"thread_start_us":61,"threads_started":1}
I20260807 18:43:45.917171 18693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.913306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49230 (local address 127.10.174.253:39887)
0807 18:43:45.913569 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:45.913579 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:45.913591 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:43:45.913630 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:45.913633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:45.913669 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:45.913789 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:45.914033 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.914784 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.915876 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.916458 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.916588 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.916629 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:45.916951 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 18:43:45.917030 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":198,"thread_start_us":86,"threads_started":1}
I20260807 18:43:45.917236 17944 leader_election.cc:302] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225fee289ca44730ba3a74e27dbbf1df, 394ad5f93504429faac6a5c1c4e70f46; no voters: 02fa2654bab74c528745865c14b78eaf
I20260807 18:43:45.917496 18684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 18:43:45.917563 18684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Starting leader election (detected failure of leader 02fa2654bab74c528745865c14b78eaf)
I20260807 18:43:45.917609 18684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:43:45.917598 17968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "394ad5f93504429faac6a5c1c4e70f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "225fee289ca44730ba3a74e27dbbf1df" is_pre_election: true
I20260807 18:43:45.918638 18684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } }
I20260807 18:43:45.918860 17968 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 394ad5f93504429faac6a5c1c4e70f46 in current term 2: Already voted for candidate 225fee289ca44730ba3a74e27dbbf1df in this term.
I20260807 18:43:45.918991 18684 leader_election.cc:288] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [CANDIDATE]: Term 2 election: Requested vote from peers 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247), 394ad5f93504429faac6a5c1c4e70f46 (127.10.174.252:34455)
I20260807 18:43:45.919373 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.919111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60868)
0807 18:43:45.919212 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.919315 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 18:43:45.919338 18160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "225fee289ca44730ba3a74e27dbbf1df" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "394ad5f93504429faac6a5c1c4e70f46"
I20260807 18:43:45.919471 18160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:43:45.920368 18160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225fee289ca44730ba3a74e27dbbf1df in term 2.
I20260807 18:43:45.920666 17944 leader_election.cc:302] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225fee289ca44730ba3a74e27dbbf1df, 394ad5f93504429faac6a5c1c4e70f46; no voters:
I20260807 18:43:45.920732 18135 leader_election.cc:302] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 394ad5f93504429faac6a5c1c4e70f46; no voters: 02fa2654bab74c528745865c14b78eaf, 225fee289ca44730ba3a74e27dbbf1df
I20260807 18:43:45.920838 18684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:43:45.921065 18684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [term 2 LEADER]: Becoming Leader. State: Replica: 225fee289ca44730ba3a74e27dbbf1df, State: Running, Role: LEADER
I20260807 18:43:45.921083 18685 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:43:45.921304 18684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } }
I20260807 18:43:45.921366 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.920968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60878)
0807 18:43:45.921270 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.921321 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232}
W20260807 18:43:45.921463 17942 leader_election.cc:334] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247): Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
I20260807 18:43:45.922365 18694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 225fee289ca44730ba3a74e27dbbf1df. Latest consensus state: current_term: 2 leader_uuid: "225fee289ca44730ba3a74e27dbbf1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:45.922456 18694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:45.922686 18696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:45.924857 18696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:45.925238 18696 catalog_manager.cc:1259] Loaded cluster ID: a45c5784cc2b46fba8a11ecf70bc1df1
I20260807 18:43:45.925285 18696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:45.925805 18696 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:45.926203 18696 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Loaded TSK: 0
I20260807 18:43:45.926817 18696 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:43:45.960052 17958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:45.963047 17958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:45.965819 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.965566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60886)
0807 18:43:45.965672 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.965744 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 18:43:45.965900 18160 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [term 2 FOLLOWER]: Refusing update from remote peer 225fee289ca44730ba3a74e27dbbf1df: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 18:43:45.966408 18694 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 18:43:45.966553 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.966319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.0.0.1:60902)
0807 18:43:45.966434 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.966485 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 18:43:45.966629 17942 consensus_peers.cc:487] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df -> Peer 02fa2654bab74c528745865c14b78eaf (127.10.174.254:35247): Couldn't send request to peer 02fa2654bab74c528745865c14b78eaf. Status: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 18:43:45.967905 18685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 225fee289ca44730ba3a74e27dbbf1df. Latest consensus state: current_term: 2 leader_uuid: "225fee289ca44730ba3a74e27dbbf1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:45.968025 18685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:45.969023 18694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "225fee289ca44730ba3a74e27dbbf1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:45.969137 18694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:45.969589 18685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "225fee289ca44730ba3a74e27dbbf1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "02fa2654bab74c528745865c14b78eaf" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35247 } } peers { permanent_uuid: "225fee289ca44730ba3a74e27dbbf1df" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 39887 } attrs { promote: false } } peers { permanent_uuid: "394ad5f93504429faac6a5c1c4e70f46" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 34455 } attrs { promote: false } } }
I20260807 18:43:45.969719 18685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 394ad5f93504429faac6a5c1c4e70f46 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:43:45.979236 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.974862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:45327 (local address 127.0.0.1:49192)
0807 18:43:45.974998 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.975009 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:45.975070 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:45.975823 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:45.975826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:45.975843 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:45.975942 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.975950 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.977122 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.977126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.978127 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.978134 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.978819 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.978822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.978923 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.978946 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:45.979044 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 18:43:45.979114 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":4}
I20260807 18:43:45.979269 18703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.975356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.10.174.195:45327)
0807 18:43:45.975599 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:45.975604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:45.975617 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:43:45.975670 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:45.975673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:45.975708 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:45.975855 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:45.976226 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.977013 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.978251 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.978679 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.978836 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.978889 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:45.979059 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 18:43:45.979135 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":70,"threads_started":1}
I20260807 18:43:45.979835 18545 tablet_service.cc:1467] Processing CreateTablet for tablet 73509d19cb9c4fc9a8a1655c22dbed22 (DEFAULT_TABLE table=test-table [id=c79e8e984e49478db5f50afe14c46e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:45.980139 18545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73509d19cb9c4fc9a8a1655c22dbed22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:45.980516 18686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.975338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44815 (local address 127.0.0.1:56838)
0807 18:43:45.975427 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.975440 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:45.975522 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:45.976759 (+ 1237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:45.976763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:45.976782 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:45.976860 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.976865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.977671 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.977676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.978909 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.978920 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.980120 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.980123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.980212 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.980235 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:45.980333 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 18:43:45.980402 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":28}
I20260807 18:43:45.980564 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.975483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56838 (local address 127.10.174.194:44815)
0807 18:43:45.976498 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:45.976504 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:45.976521 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:43:45.976595 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:45.976598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:45.976642 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:45.976743 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:45.976993 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.977560 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.979056 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.980009 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.980120 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.980167 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:45.980352 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 18:43:45.980425 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":883,"thread_start_us":71,"threads_started":1}
I20260807 18:43:45.981359 18705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.975645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:39873 (local address 127.0.0.1:47570)
0807 18:43:45.975867 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.975880 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:45.975971 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:45.976560 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:45.976563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:45.976581 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:45.976672 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.976683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.977831 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.977835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.979021 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:45.979030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.981062 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.981065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:45.981128 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.981146 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:45.981209 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 18:43:45.981269 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":39,"thread_start_us":88,"threads_started":1}
I20260807 18:43:45.981487 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.976074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47570 (local address 127.10.174.193:39873)
0807 18:43:45.976309 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:45.976315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:45.976331 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:45.976383 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:45.976386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:45.976432 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:45.976787 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:45.976929 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.977702 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.979450 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:45.980015 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:45.980139 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:45.980208 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:45.981262 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0807 18:43:45.981360 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260807 18:43:45.982481 18707 tablet_bootstrap.cc:492] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Bootstrap starting.
I20260807 18:43:45.982648 18405 tablet_service.cc:1467] Processing CreateTablet for tablet 73509d19cb9c4fc9a8a1655c22dbed22 (DEFAULT_TABLE table=test-table [id=c79e8e984e49478db5f50afe14c46e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:45.982969 18405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73509d19cb9c4fc9a8a1655c22dbed22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:45.983558 18707 tablet_bootstrap.cc:654] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:45.984647 18707 tablet_bootstrap.cc:492] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: No bootstrap required, opened a new log
I20260807 18:43:45.984766 18707 ts_tablet_manager.cc:1397] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:45.985121 18707 raft_consensus.cc:348] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:45.985234 18707 raft_consensus.cc:374] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:45.985275 18707 raft_consensus.cc:729] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed82c5042ddd41808def79d8e43743a2, State: Initialized, Role: FOLLOWER
I20260807 18:43:45.985258 18709 tablet_bootstrap.cc:492] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Bootstrap starting.
I20260807 18:43:45.985401 18707 consensus_queue.cc:260] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:45.985672 18264 tablet_service.cc:1467] Processing CreateTablet for tablet 73509d19cb9c4fc9a8a1655c22dbed22 (DEFAULT_TABLE table=test-table [id=c79e8e984e49478db5f50afe14c46e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:45.985740 18707 ts_tablet_manager.cc:1428] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:45.985917 18264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73509d19cb9c4fc9a8a1655c22dbed22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:45.986634 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.986130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:47925)
0807 18:43:45.986421 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.986475 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":89,"threads_started":1}
I20260807 18:43:45.986814 18709 tablet_bootstrap.cc:654] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:45.988212 18709 tablet_bootstrap.cc:492] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: No bootstrap required, opened a new log
I20260807 18:43:45.988276 18709 ts_tablet_manager.cc:1397] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 18:43:45.988744 18709 raft_consensus.cc:348] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:45.988886 18709 raft_consensus.cc:374] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:45.988926 18709 raft_consensus.cc:729] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7ee7ca2bba4ebb819ea05fc962bd3a, State: Initialized, Role: FOLLOWER
I20260807 18:43:45.989058 18709 consensus_queue.cc:260] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:45.989348 18713 tablet_bootstrap.cc:492] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066: Bootstrap starting.
I20260807 18:43:45.989444 18709 ts_tablet_manager.cc:1428] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260807 18:43:45.990183 18713 tablet_bootstrap.cc:654] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:45.990435 18715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.989803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:56417)
0807 18:43:45.990267 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.990327 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":89,"threads_started":1}
I20260807 18:43:45.991261 18715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.990852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:45413)
0807 18:43:45.991123 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.991188 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":85,"threads_started":1}
I20260807 18:43:45.991281 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.991014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:43019)
0807 18:43:45.991152 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.991203 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 18:43:45.991348 18475 heartbeater.cc:503] Master 127.10.174.253:39887 was elected leader, sending a full tablet report...
I20260807 18:43:45.991677 18615 heartbeater.cc:503] Master 127.10.174.253:39887 was elected leader, sending a full tablet report...
I20260807 18:43:45.992274 18713 tablet_bootstrap.cc:492] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066: No bootstrap required, opened a new log
I20260807 18:43:45.992362 18713 ts_tablet_manager.cc:1397] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 18:43:45.992821 18713 raft_consensus.cc:348] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:45.992936 18713 raft_consensus.cc:374] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:45.992977 18713 raft_consensus.cc:729] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8aeb11509944b308a29bb6317067066, State: Initialized, Role: FOLLOWER
I20260807 18:43:45.993129 18713 consensus_queue.cc:260] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:45.993482 18713 ts_tablet_manager.cc:1428] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:45.994730 18719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.993803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:42109)
0807 18:43:45.994042 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.994102 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":115,"threads_started":1}
I20260807 18:43:45.995082 18333 heartbeater.cc:503] Master 127.10.174.253:39887 was elected leader, sending a full tablet report...
I20260807 18:43:45.995537 18719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:45.995213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:59195)
0807 18:43:45.995403 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:45.995451 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260807 18:43:46.047932 18710 raft_consensus.cc:482] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:46.048100 18710 raft_consensus.cc:504] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:46.049144 18710 leader_election.cc:288] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873), 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815)
I20260807 18:43:46.052865 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.049499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:47041 (local address 127.10.174.193:39873)
0807 18:43:46.049632 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:46.049637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:46.049651 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:46.049728 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:46.049731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:46.049790 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:46.049872 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:46.050116 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.050607 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.051719 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.052307 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.052444 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:46.052500 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:46.052678 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 18:43:46.052746 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 18:43:46.052865 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.049377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:39873 (local address 127.10.174.195:47041)
0807 18:43:46.049514 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.049530 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:46.049634 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:46.049882 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:46.049885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:46.049903 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:46.050008 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:46.050014 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.050714 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.050720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:46.051607 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:46.051620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.052444 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.052448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:46.052559 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:46.052577 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:43:46.052663 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 18:43:46.052732 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 18:43:46.053277 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.049485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:32949 (local address 127.10.174.194:44815)
0807 18:43:46.049639 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:46.049645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:46.049986 (+ 341us) server_negotiation.cc:407] Connection header received
0807 18:43:46.050133 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:46.050136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:46.050186 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:46.050268 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:46.050515 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.050991 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.052311 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.052717 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.052848 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:46.052908 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:46.053104 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 18:43:46.053178 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:43:46.053289 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.049377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44815 (local address 127.10.174.195:32949)
0807 18:43:46.049890 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.049901 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:46.050016 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:46.050279 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:46.050281 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:46.050296 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:46.050405 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:46.050411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.051112 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.051116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:46.052209 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:46.052221 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.052840 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.052844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:46.052954 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:46.052979 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 18:43:46.053086 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 18:43:46.053150 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":178,"thread_start_us":186,"threads_started":1}
I20260807 18:43:46.053378 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73509d19cb9c4fc9a8a1655c22dbed22" candidate_uuid: "ed82c5042ddd41808def79d8e43743a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8aeb11509944b308a29bb6317067066" is_pre_election: true
I20260807 18:43:46.053606 18285 raft_consensus.cc:2454] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed82c5042ddd41808def79d8e43743a2 in term 0.
I20260807 18:43:46.053779 18426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73509d19cb9c4fc9a8a1655c22dbed22" candidate_uuid: "ed82c5042ddd41808def79d8e43743a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" is_pre_election: true
I20260807 18:43:46.053936 18426 raft_consensus.cc:2454] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed82c5042ddd41808def79d8e43743a2 in term 0.
I20260807 18:43:46.054044 18501 leader_election.cc:302] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8aeb11509944b308a29bb6317067066, ed82c5042ddd41808def79d8e43743a2; no voters:
I20260807 18:43:46.054289 18710 raft_consensus.cc:2781] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:46.054333 18710 raft_consensus.cc:482] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:46.054358 18710 raft_consensus.cc:3037] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:46.055672 18710 raft_consensus.cc:504] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:46.055950 18710 leader_election.cc:288] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [CANDIDATE]: Term 1 election: Requested vote from peers e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873), 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815)
I20260807 18:43:46.056326 18426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73509d19cb9c4fc9a8a1655c22dbed22" candidate_uuid: "ed82c5042ddd41808def79d8e43743a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a"
I20260807 18:43:46.056468 18426 raft_consensus.cc:3037] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:46.056448 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73509d19cb9c4fc9a8a1655c22dbed22" candidate_uuid: "ed82c5042ddd41808def79d8e43743a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8aeb11509944b308a29bb6317067066"
I20260807 18:43:46.056550 18285 raft_consensus.cc:3037] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:46.057592 18426 raft_consensus.cc:2454] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed82c5042ddd41808def79d8e43743a2 in term 1.
I20260807 18:43:46.057624 18285 raft_consensus.cc:2454] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed82c5042ddd41808def79d8e43743a2 in term 1.
I20260807 18:43:46.057895 18498 leader_election.cc:302] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7ee7ca2bba4ebb819ea05fc962bd3a, ed82c5042ddd41808def79d8e43743a2; no voters:
I20260807 18:43:46.058076 18710 raft_consensus.cc:2781] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:46.058259 18710 raft_consensus.cc:686] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 1 LEADER]: Becoming Leader. State: Replica: ed82c5042ddd41808def79d8e43743a2, State: Running, Role: LEADER
I20260807 18:43:46.058501 18710 consensus_queue.cc:237] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } }
I20260807 18:43:46.058879 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.058664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:49039)
0807 18:43:46.058793 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.058832 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 18:43:46.060618 17957 catalog_manager.cc:5495] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed82c5042ddd41808def79d8e43743a2 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "ed82c5042ddd41808def79d8e43743a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed82c5042ddd41808def79d8e43743a2" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 45327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:46.078613 18703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.075358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49206 (local address 127.10.174.195:45327)
0807 18:43:46.075477 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:46.075481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:46.075503 (+ 22us) server_negotiation.cc:407] Connection header received
0807 18:43:46.075623 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:46.075625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:46.075677 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:46.075763 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:46.075996 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.076529 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.077435 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:46.077656 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:46.077739 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:46.077946 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:46.078351 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:46.078433 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:46.078485 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 18:43:46.078525 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:43:46.081036 18426 raft_consensus.cc:1261] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Refusing update from remote peer ed82c5042ddd41808def79d8e43743a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:46.081250 18285 raft_consensus.cc:1261] T 73509d19cb9c4fc9a8a1655c22dbed22 P e8aeb11509944b308a29bb6317067066 [term 1 FOLLOWER]: Refusing update from remote peer ed82c5042ddd41808def79d8e43743a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:46.081543 18710 consensus_queue.cc:1035] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7ee7ca2bba4ebb819ea05fc962bd3a" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:46.081797 18722 consensus_queue.cc:1035] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8aeb11509944b308a29bb6317067066" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:46.083328 18719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.083025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:35109)
0807 18:43:46.083180 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.083238 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 18:43:46.083491 18717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.083127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:43719)
0807 18:43:46.083335 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.083397 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260807 18:43:46.088019 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.087346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:41031)
0807 18:43:46.087891 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.087944 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478}
I20260807 18:43:46.088745 18717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.088427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.194:50269)
0807 18:43:46.088644 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.088696 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260807 18:43:46.090263 18719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.089873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.193:50667)
0807 18:43:46.090153 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.090205 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217}
I20260807 18:43:46.090263 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.090030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35247 (local address 127.10.174.195:43175)
0807 18:43:46.090153 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.090206 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:35247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 18:43:46.094914 17958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:46.095072 17958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:46.098783 17958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 225fee289ca44730ba3a74e27dbbf1df: Sending DeleteTablet for 3 replicas of tablet 73509d19cb9c4fc9a8a1655c22dbed22
I20260807 18:43:46.099555 18545 tablet_service.cc:1514] Processing DeleteTablet for tablet 73509d19cb9c4fc9a8a1655c22dbed22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:46 UTC) from {username='oryx', principal='oryx/127.10.174.253@KRBTEST.COM'} at 127.0.0.1:49192
I20260807 18:43:46.099651 18405 tablet_service.cc:1514] Processing DeleteTablet for tablet 73509d19cb9c4fc9a8a1655c22dbed22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:46 UTC) from {username='oryx', principal='oryx/127.10.174.253@KRBTEST.COM'} at 127.0.0.1:56838
I20260807 18:43:46.100562 18736 tablet_replica.cc:330] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: stopping tablet replica
I20260807 18:43:46.100685 18736 raft_consensus.cc:2229] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:46.100932 18736 raft_consensus.cc:2258] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:46.101509 18736 ts_tablet_manager.cc:1905] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:46.103384 18264 tablet_service.cc:1514] Processing DeleteTablet for tablet 73509d19cb9c4fc9a8a1655c22dbed22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:46 UTC) from {username='oryx', principal='oryx/127.10.174.253@KRBTEST.COM'} at 127.0.0.1:47570
I20260807 18:43:46.103554 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 18109
I20260807 18:43:46.103828 18737 tablet_replica.cc:330] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: stopping tablet replica
I20260807 18:43:46.103967 18737 raft_consensus.cc:2229] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:46.104179 18737 raft_consensus.cc:2258] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:46.105701 18737 ts_tablet_manager.cc:1905] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:46.107856 18736 ts_tablet_manager.cc:1918] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:46.107936 18736 log.cc:1196] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/73509d19cb9c4fc9a8a1655c22dbed22
I20260807 18:43:46.108237 18736 ts_tablet_manager.cc:1939] T 73509d19cb9c4fc9a8a1655c22dbed22 P ed82c5042ddd41808def79d8e43743a2: Deleting consensus metadata
I20260807 18:43:46.108421 18737 ts_tablet_manager.cc:1918] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:46.108566 18737 log.cc:1196] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/73509d19cb9c4fc9a8a1655c22dbed22
I20260807 18:43:46.108908 18737 ts_tablet_manager.cc:1939] T 73509d19cb9c4fc9a8a1655c22dbed22 P 1e7ee7ca2bba4ebb819ea05fc962bd3a: Deleting consensus metadata
I20260807 18:43:46.108978 17941 catalog_manager.cc:4841] TS ed82c5042ddd41808def79d8e43743a2 (127.10.174.195:45327): tablet 73509d19cb9c4fc9a8a1655c22dbed22 (table test-table [id=c79e8e984e49478db5f50afe14c46e24]) successfully deleted
I20260807 18:43:46.109615 17941 catalog_manager.cc:4841] TS 1e7ee7ca2bba4ebb819ea05fc962bd3a (127.10.174.194:44815): tablet 73509d19cb9c4fc9a8a1655c22dbed22 (table test-table [id=c79e8e984e49478db5f50afe14c46e24]) successfully deleted
I20260807 18:43:46.119513 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 18339
I20260807 18:43:46.119836 18705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:46.119516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:39873 (local address 127.0.0.1:47576)
0807 18:43:46.119677 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:46.119742 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:39873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 18:43:46.120117 17944 catalog_manager.cc:4584] TS e8aeb11509944b308a29bb6317067066 (127.10.174.193:39873): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 73509d19cb9c4fc9a8a1655c22dbed22: Network error: Client connection negotiation failed: client connection to 127.10.174.193:39873: connect: Connection refused (error 111)
I20260807 18:43:46.127135 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 18480
I20260807 18:43:46.135438 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17818
I20260807 18:43:46.141834 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 17920
2026-08-07T18:43:46Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6154 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:46 dist-test-slave-07c2 krb5kdc[18742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:46 dist-test-slave-07c2 krb5kdc[18742](info): set up 2 sockets
Aug 07 18:43:46 dist-test-slave-07c2 krb5kdc[18742](info): commencing operation
krb5kdc: starting...
W20260807 18:43:47.210628 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:47Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab.
Entry for principal oryx/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab.
I20260807 18:43:47.328406 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39667
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab
--principal=oryx/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:39667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:47.437913 18756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:47.438166 18756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:47.438205 18756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:47.442193 18756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:47.442250 18756 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 18:43:47.442267 18756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:47.442286 18756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:47.442348 18756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:47.442368 18756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:47.447633 18756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:39667
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.254.keytab
--principal=oryx/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:47.448661 18756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:47.449658 18756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:47.457787 18762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:47.457813 18764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:47.457825 18761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:47.458184 18756 server_base.cc:1034] running on GCE node
I20260807 18:43:47.458664 18756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:47.459699 18756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:47.460868 18756 hybrid_clock.cc:648] HybridClock initialized: now 1786128227460844 us; error 37 us; skew 500 ppm
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:47.468142 18756 init.cc:377] Logged in from keytab as oryx/127.10.174.254@KRBTEST.COM (short username oryx)
I20260807 18:43:47.468986 18756 webserver.cc:460] Webserver started at http://127.10.174.254:43305/ using document root <none> and password file <none>
I20260807 18:43:47.469502 18756 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:47.469559 18756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:47.469722 18756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:47.471796 18756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "6fd8c516acd341eaad2b744fcf79913e"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "d0d561ec59d387c29868ad9ceb2786c1"
server_key_iv: "45c8ab992198ca7492c666ad342d0bb2"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.472314 18756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "6fd8c516acd341eaad2b744fcf79913e"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "d0d561ec59d387c29868ad9ceb2786c1"
server_key_iv: "45c8ab992198ca7492c666ad342d0bb2"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.476178 18756 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 18:43:47.478464 18771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:47.479741 18756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 18:43:47.479844 18756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "6fd8c516acd341eaad2b744fcf79913e"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "d0d561ec59d387c29868ad9ceb2786c1"
server_key_iv: "45c8ab992198ca7492c666ad342d0bb2"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.479933 18756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:47.493914 18756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:47.497001 18756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:47.497167 18756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:47.505064 18756 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:39667
I20260807 18:43:47.505096 18835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:39667 every 8 connection(s)
I20260807 18:43:47.505992 18756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:47.508656 18836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:47.513911 18836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Bootstrap starting.
I20260807 18:43:47.514650 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 18756
I20260807 18:43:47.514760 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:47.515049 10939 external_mini_cluster.cc:1428] Setting key faff4bc673f9ade8b24287b6c10daceb
I20260807 18:43:47.516626 18836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:47.517364 18836 log.cc:824] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:47.519618 18836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: No bootstrap required, opened a new log
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:47.524067 18836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd8c516acd341eaad2b744fcf79913e" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39667 } }
I20260807 18:43:47.524391 18836 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:47.524469 18836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd8c516acd341eaad2b744fcf79913e, State: Initialized, Role: FOLLOWER
I20260807 18:43:47.524924 18836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd8c516acd341eaad2b744fcf79913e" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39667 } }
I20260807 18:43:47.525077 18836 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:47.525148 18836 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:47.525270 18836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:47.526492 18836 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd8c516acd341eaad2b744fcf79913e" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39667 } }
I20260807 18:43:47.526937 18836 leader_election.cc:302] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fd8c516acd341eaad2b744fcf79913e; no voters:
I20260807 18:43:47.527382 18836 leader_election.cc:288] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:47.527477 18841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:47.527740 18841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [term 1 LEADER]: Becoming Leader. State: Replica: 6fd8c516acd341eaad2b744fcf79913e, State: Running, Role: LEADER
I20260807 18:43:47.528049 18841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd8c516acd341eaad2b744fcf79913e" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39667 } }
I20260807 18:43:47.528787 18836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:47.529645 18842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fd8c516acd341eaad2b744fcf79913e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd8c516acd341eaad2b744fcf79913e" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39667 } } }
I20260807 18:43:47.529775 18842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:47.530182 18843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fd8c516acd341eaad2b744fcf79913e. Latest consensus state: current_term: 1 leader_uuid: "6fd8c516acd341eaad2b744fcf79913e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd8c516acd341eaad2b744fcf79913e" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39667 } } }
I20260807 18:43:47.530324 18843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:47.530575 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.516225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.10.174.254:39667)
0807 18:43:47.516704 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:47.516719 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:47.516777 (+ 58us) server_negotiation.cc:407] Connection header received
0807 18:43:47.517418 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:47.517434 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:47.517842 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:47.518212 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:47.519107 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.520206 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.521427 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.521888 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.522003 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.524874 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:47.524880 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:47.524892 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:47.524918 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:47.526614 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.527214 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.527222 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.527231 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.527405 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.527760 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.527763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.527765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.528249 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:47.529052 (+ 803us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:47.529216 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 18:43:47.529525 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":162,"threads_started":1}
W20260807 18:43:47.534402 18859 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:47.534468 18859 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:47.534557 18851 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:47.535254 18851 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:47.540555 18851 catalog_manager.cc:1347] Generated new cluster ID: d39135ccd77d423dbb14ef401789fdf9
I20260807 18:43:47.540621 18851 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:47.549355 18851 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:47.550545 18851 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:47.563481 18851 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Generated new TSK 0
I20260807 18:43:47.564294 18851 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab.
Entry for principal oryx/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab.
I20260807 18:43:47.598429 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39667
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:47.709100 18865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:47.709350 18865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:47.709393 18865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:47.713317 18865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:47.713368 18865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:47.713406 18865 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:47.713438 18865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:47.718518 18865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:39667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:47.719883 18865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:47.720903 18865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:47.730480 18871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:47.730455 18870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:47.730477 18873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:47.730552 18865 server_base.cc:1034] running on GCE node
I20260807 18:43:47.731139 18865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:47.731853 18865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:47.733037 18865 hybrid_clock.cc:648] HybridClock initialized: now 1786128227733029 us; error 30 us; skew 500 ppm
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:47.735809 18865 init.cc:377] Logged in from keytab as oryx/127.10.174.193@KRBTEST.COM (short username oryx)
I20260807 18:43:47.736618 18865 webserver.cc:460] Webserver started at http://127.10.174.193:33043/ using document root <none> and password file <none>
I20260807 18:43:47.737134 18865 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:47.737196 18865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:47.737355 18865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:47.739255 18865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "cd6830bca6bd41b3960591b4ef186223"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "f69a92e54b4ad08a7d388f6e83b44a4e"
server_key_iv: "a7c4a2b17a168dc0f53f0122f608554f"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.739826 18865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "cd6830bca6bd41b3960591b4ef186223"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "f69a92e54b4ad08a7d388f6e83b44a4e"
server_key_iv: "a7c4a2b17a168dc0f53f0122f608554f"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.743243 18865 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:43:47.745532 18880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:47.746687 18865 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:47.746814 18865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "cd6830bca6bd41b3960591b4ef186223"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "f69a92e54b4ad08a7d388f6e83b44a4e"
server_key_iv: "a7c4a2b17a168dc0f53f0122f608554f"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.746928 18865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:47.765014 18865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:47.767930 18865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:47.768148 18865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:47.769621 18865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:47.769671 18865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:47.769738 18865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:47.769770 18865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:47.781037 18865 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:36963
I20260807 18:43:47.781431 19000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:36963 every 8 connection(s)
I20260807 18:43:47.782194 18865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:47.784464 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.770566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43955 (local address 127.10.174.254:39667)
0807 18:43:47.770711 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:47.770715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:47.771807 (+ 1092us) server_negotiation.cc:407] Connection header received
0807 18:43:47.772867 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:47.772872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:47.772940 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:47.773000 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:47.774857 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.775852 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.777401 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.777853 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.777974 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.780519 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:47.780525 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:47.780528 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:47.780557 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:47.782261 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.782823 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.782827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.782829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.782923 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.783392 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.783396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.783398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.783584 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:47.783683 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:47.784157 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 18:43:47.784295 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 18:43:47.785141 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.771131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.10.174.193:43955)
0807 18:43:47.771646 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:47.771687 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:47.772584 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:47.773479 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:47.773489 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:47.773957 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:47.774664 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.774683 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.776003 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.776010 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.777259 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.777268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.778015 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.778018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.778155 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.778817 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:47.778840 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:47.780339 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:47.782368 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:47.782372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:47.782382 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:47.782620 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:47.783061 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:47.783067 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:47.783071 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:47.783230 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:47.783677 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:47.783681 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:47.783916 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 18:43:47.784091 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 18:43:47.784393 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":169,"threads_started":1}
I20260807 18:43:47.785432 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 18865
I20260807 18:43:47.785593 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:47.785995 10939 external_mini_cluster.cc:1428] Setting key dcb0b8cf6160faa05712a544a99e6064
I20260807 18:43:47.786505 19001 heartbeater.cc:347] Connected to a master server at 127.10.174.254:39667
I20260807 18:43:47.786684 19001 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:47.787212 19001 heartbeater.cc:511] Master 127.10.174.254:39667 requested a full tablet report, sending...
I20260807 18:43:47.788861 18788 ts_manager.cc:194] Registered new tserver with Master: cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963)
I20260807 18:43:47.790372 18788 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:43955
I20260807 18:43:47.797987 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.790542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:51363 (local address 127.10.174.254:39667)
0807 18:43:47.790673 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:47.790679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:47.790693 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:47.790732 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:47.790737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:47.790793 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:47.790879 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:47.791491 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.791993 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.793270 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.793492 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.793572 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.794883 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:47.794886 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:47.794888 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:47.794907 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:47.796323 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.796841 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.796844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.796845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.796912 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.797218 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.797220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.797221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.797364 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:47.797437 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:47.797792 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 18:43:47.797881 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 18:43:47.798241 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.788490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.10.174.193:51363)
0807 18:43:47.788788 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:47.788800 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:47.788868 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:47.790932 (+ 2064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:47.790936 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:47.791200 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:47.791364 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.791379 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.792127 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.792133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.793121 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.793136 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.793618 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.793624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.793760 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.794270 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:47.794288 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:47.794723 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:47.796438 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:47.796444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:47.796446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:47.796732 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:47.797000 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:47.797005 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:47.797010 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:47.797114 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:47.797486 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:47.797492 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:47.797598 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 18:43:47.797729 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 18:43:47.797891 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":145,"threads_started":1}
WARNING: no policy specified for oryx/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab.
Entry for principal oryx/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab.
I20260807 18:43:47.815651 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39667
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:47.924314 19010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:47.924616 19010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:47.924703 19010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:47.928791 19010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:47.928882 19010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:47.928951 19010 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:47.929028 19010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:47.934279 19010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:39667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:47.935369 19010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:47.936337 19010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:47.945791 19016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:47.945851 19010 server_base.cc:1034] running on GCE node
W20260807 18:43:47.945863 19018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:47.946044 19015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:47.946434 19010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:47.946967 19010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:47.948122 19010 hybrid_clock.cc:648] HybridClock initialized: now 1786128227948106 us; error 25 us; skew 500 ppm
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:47.950896 19010 init.cc:377] Logged in from keytab as oryx/127.10.174.194@KRBTEST.COM (short username oryx)
I20260807 18:43:47.951685 19010 webserver.cc:460] Webserver started at http://127.10.174.194:43449/ using document root <none> and password file <none>
I20260807 18:43:47.952158 19010 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:47.952214 19010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:47.952370 19010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:47.954216 19010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "9dec69e0114549a49d557ae1df9d5288"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "35df5de0bed4903bd1f724838be4d23c"
server_key_iv: "12923301d9441fe036de716997399eb2"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.954710 19010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "9dec69e0114549a49d557ae1df9d5288"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "35df5de0bed4903bd1f724838be4d23c"
server_key_iv: "12923301d9441fe036de716997399eb2"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.958029 19010 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:43:47.960222 19025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:47.961372 19010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:47.961500 19010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "9dec69e0114549a49d557ae1df9d5288"
format_stamp: "Formatted at 2026-08-07 18:43:47 on dist-test-slave-07c2"
server_key: "35df5de0bed4903bd1f724838be4d23c"
server_key_iv: "12923301d9441fe036de716997399eb2"
server_key_version: "encryptionkey@0"
I20260807 18:43:47.961604 19010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:47.972901 19010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:47.975942 19010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:47.976142 19010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:47.977502 19010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:47.977571 19010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:47.977633 19010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:47.977682 19010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:47 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:47.988685 19010 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:36321
I20260807 18:43:47.988742 19144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:36321 every 8 connection(s)
I20260807 18:43:47.989770 19010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:47.991165 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19010
I20260807 18:43:47.991279 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:47.991665 10939 external_mini_cluster.cc:1428] Setting key 1ff577ca94feba11fbdd0ea9a1cef816
I20260807 18:43:47.991732 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.978269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:37179 (local address 127.10.174.254:39667)
0807 18:43:47.978436 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:47.978442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:47.979229 (+ 787us) server_negotiation.cc:407] Connection header received
0807 18:43:47.980342 (+ 1113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:47.980346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:47.980405 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:47.980497 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:47.982086 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.982953 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.984709 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.985123 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.985244 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.987840 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:47.987843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:47.987846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:47.987873 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:47.989552 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.990104 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.990108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.990110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.990210 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:47.990561 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:47.990566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:47.990571 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:47.990797 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:47.990909 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:47.991443 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 18:43:47.991573 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 18:43:47.992553 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.978613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.10.174.194:37179)
0807 18:43:47.979052 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:47.979099 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:47.980063 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:47.980704 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:47.980715 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:47.981208 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:47.981864 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.981886 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.983068 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.983072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.984556 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.984569 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.985308 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.985312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.985460 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:47.985983 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:47.985998 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:47.987681 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:47.989674 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:47.989679 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:47.989688 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:47.989984 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:47.990299 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:47.990305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:47.990306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:47.990468 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:47.990907 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:47.990913 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:47.991133 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 18:43:47.991370 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 18:43:47.991626 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":124,"threads_started":1}
I20260807 18:43:47.993757 19145 heartbeater.cc:347] Connected to a master server at 127.10.174.254:39667
I20260807 18:43:47.993916 19145 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:47.994372 19145 heartbeater.cc:511] Master 127.10.174.254:39667 requested a full tablet report, sending...
I20260807 18:43:47.995427 18789 ts_manager.cc:194] Registered new tserver with Master: 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321)
I20260807 18:43:47.996227 18789 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:37179
WARNING: no policy specified for oryx/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:43:48.003942 19152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.996040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.10.174.194:50925)
0807 18:43:47.996607 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:47.996619 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:47.996730 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:47.996970 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:47.996973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:47.997167 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:47.997280 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.997287 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.998404 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.998407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.999059 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:47.999070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.999767 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.999770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:47.999839 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.000325 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:48.000336 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:48.000625 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:48.002464 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.002467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.002468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.002647 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.002949 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.002951 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.002953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.003022 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.003544 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:48.003546 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:48.003617 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.003696 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.003808 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":96,"threads_started":1}
I20260807 18:43:48.003943 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:47.996079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:50925 (local address 127.10.174.254:39667)
0807 18:43:47.996190 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:47.996194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:47.996695 (+ 501us) server_negotiation.cc:407] Connection header received
0807 18:43:47.996803 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:47.996808 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:47.996859 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:47.996933 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:47.997406 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.998264 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.999171 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:47.999630 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:47.999772 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.000764 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:48.000770 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:48.000776 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:48.000801 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:48.002355 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.002753 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.002759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.002762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.002857 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.003107 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.003111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.003112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.003443 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:48.003570 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.003753 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.003840 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab.
Entry for principal oryx/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab.
I20260807 18:43:48.019979 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39667
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:48.129420 19154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:48.129688 19154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:48.129732 19154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:48.133685 19154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:48.133736 19154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:48.133772 19154 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 18:43:48.133812 19154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:48.138715 19154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.174.254:39667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:48.139626 19154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:48.140545 19154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:48.150012 19159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:48.150105 19160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:48.150063 19162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:48.150256 19154 server_base.cc:1034] running on GCE node
I20260807 18:43:48.150733 19154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:48.151427 19154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:48.152601 19154 hybrid_clock.cc:648] HybridClock initialized: now 1786128228152586 us; error 35 us; skew 500 ppm
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128228, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:48.155180 19154 init.cc:377] Logged in from keytab as oryx/127.10.174.195@KRBTEST.COM (short username oryx)
I20260807 18:43:48.156021 19154 webserver.cc:460] Webserver started at http://127.10.174.195:45771/ using document root <none> and password file <none>
I20260807 18:43:48.156546 19154 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:48.156635 19154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:48.156863 19154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:48.158766 19154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
format_stamp: "Formatted at 2026-08-07 18:43:48 on dist-test-slave-07c2"
server_key: "99be21d31ee505e985039b09627ddebd"
server_key_iv: "5adf4f05138a07f02cd0dd1d1ff00778"
server_key_version: "encryptionkey@0"
I20260807 18:43:48.159368 19154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
format_stamp: "Formatted at 2026-08-07 18:43:48 on dist-test-slave-07c2"
server_key: "99be21d31ee505e985039b09627ddebd"
server_key_iv: "5adf4f05138a07f02cd0dd1d1ff00778"
server_key_version: "encryptionkey@0"
I20260807 18:43:48.162725 19154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:43:48.165009 19169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:48.166172 19154 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:48.166301 19154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
format_stamp: "Formatted at 2026-08-07 18:43:48 on dist-test-slave-07c2"
server_key: "99be21d31ee505e985039b09627ddebd"
server_key_iv: "5adf4f05138a07f02cd0dd1d1ff00778"
server_key_version: "encryptionkey@0"
I20260807 18:43:48.166406 19154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:48.188264 19154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:48.190855 19154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:48.191043 19154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:48.192399 19154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:48.192469 19154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:48.192533 19154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:48.192585 19154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128228, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:48.203426 19154 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:43857
I20260807 18:43:48.203507 19287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:43857 every 8 connection(s)
I20260807 18:43:48.204489 19154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:48.205895 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19154
I20260807 18:43:48.206009 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:48.206278 10939 external_mini_cluster.cc:1428] Setting key b3940bf934cf2fc3af29b1234857f497
I20260807 18:43:48.207334 19178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.193563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.10.174.195:51115)
0807 18:43:48.193991 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.194039 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.194981 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.195838 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.195848 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.196156 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:48.196630 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.196648 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.197493 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.197496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.198642 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.198651 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.199151 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.199155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.199383 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.199968 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:48.199984 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:48.202353 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:48.204488 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.204493 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.204502 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.204800 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.205153 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.205156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.205169 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.205325 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.205700 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:48.205704 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:48.205899 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.206121 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.206400 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":126,"threads_started":1}
I20260807 18:43:48.207703 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.193214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:51115 (local address 127.10.174.254:39667)
0807 18:43:48.193373 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.193380 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.194144 (+ 764us) server_negotiation.cc:407] Connection header received
0807 18:43:48.195225 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.195232 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.195294 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.195383 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.196792 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.197367 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.198769 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.198988 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.199104 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.202516 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:48.202520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:48.202522 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:48.202549 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:48.204377 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.204949 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.204953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.204955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.205045 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.205411 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.205414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.205416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.205598 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:48.205710 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.207421 (+ 1711us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.207549 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:43:48.208936 19288 heartbeater.cc:347] Connected to a master server at 127.10.174.254:39667
I20260807 18:43:48.209079 19288 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:48.209527 19288 heartbeater.cc:511] Master 127.10.174.254:39667 requested a full tablet report, sending...
I20260807 18:43:48.210443 18789 ts_manager.cc:194] Registered new tserver with Master: b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:48.211187 18789 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:51115
I20260807 18:43:48.217248 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.210953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:33121 (local address 127.10.174.254:39667)
0807 18:43:48.211070 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.211073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.211224 (+ 151us) server_negotiation.cc:407] Connection header received
0807 18:43:48.211417 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.211419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.211456 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.211559 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.212018 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.212480 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.213390 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.213582 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.213655 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.214521 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:48.214524 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:48.214526 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:48.214546 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:48.216017 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.216374 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.216376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.216377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.216445 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.216675 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.216677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.216678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.216820 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:48.216893 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.217071 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.217147 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:48.217263 19295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.210884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.10.174.195:33121)
0807 18:43:48.211157 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.211170 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.211276 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.211595 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.211597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.211789 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:48.211905 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.211912 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.212606 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.212610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.213291 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.213300 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.213672 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.213675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.213742 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.214113 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:48.214124 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:48.214405 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:48.216110 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.216113 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.216114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.216291 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.216523 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.216525 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.216526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.216595 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.216898 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:48.216900 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:48.216965 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.217039 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.217131 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
I20260807 18:43:48.219869 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128228, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 18:43:48.243656 18839 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:48.237670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59438 (local address 127.10.174.254:39667)
0807 18:43:48.237802 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.237805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.237819 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:48.237862 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.237864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.237903 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.237980 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.238668 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.239185 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.240029 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.240247 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.240328 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.243483 (+ 3155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59438: BlockingRecv error: recv got EOF from 127.0.0.1:59438 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128228, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:48.253070 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.244947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59452 (local address 127.10.174.254:39667)
0807 18:43:48.245088 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.245092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.245221 (+ 129us) server_negotiation.cc:407] Connection header received
0807 18:43:48.245372 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.245375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.245426 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.245506 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.246104 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.246606 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.247430 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.247656 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.247767 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.250061 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:48.250064 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:48.250067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:48.250100 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:48.251649 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.252022 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.252025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.252026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.252098 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.252319 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.252321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.252322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.252481 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:48.252579 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.252773 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.252860 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:43:48.255918 18789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:48.258787 18789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:48.273218 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.266860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60660 (local address 127.10.174.193:36963)
0807 18:43:48.267151 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.267170 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.267727 (+ 557us) server_negotiation.cc:407] Connection header received
0807 18:43:48.267820 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.267826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.268021 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.268182 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.268466 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.269632 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.271375 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.272191 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.272336 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.272466 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.272946 (+ 480us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.273053 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":87,"threads_started":1}
I20260807 18:43:48.273468 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.268017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40036 (local address 127.10.174.194:36321)
0807 18:43:48.268446 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.268457 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.268528 (+ 71us) server_negotiation.cc:407] Connection header received
0807 18:43:48.268644 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.268649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.268865 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.269002 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.269273 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.270291 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.271738 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.272541 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.272683 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.272809 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.273215 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.273322 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":107,"threads_started":1}
I20260807 18:43:48.273262 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.266810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:43857 (local address 127.0.0.1:48288)
0807 18:43:48.267738 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.267753 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.267833 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.269327 (+ 1494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.269329 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.269343 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.269397 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.269400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.270799 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.270802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.271755 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.271763 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.272530 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.272534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.272714 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.272804 (+ 90us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.272913 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.273110 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":123,"thread_start_us":86,"threads_started":1}
I20260807 18:43:48.273705 19315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.267533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48288 (local address 127.10.174.195:43857)
0807 18:43:48.268750 (+ 1217us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.268758 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.268775 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:43:48.268829 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.268832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.269028 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.269178 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.269506 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.270643 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.271880 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.272404 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.272565 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.272701 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.273439 (+ 738us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.273565 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1137,"thread_start_us":108,"threads_started":1}
I20260807 18:43:48.273710 19312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.267473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36321 (local address 127.0.0.1:40036)
0807 18:43:48.268452 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.268464 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.268554 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.269015 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.269018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.269035 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.269150 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.269156 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.270446 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.270451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.271595 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.271606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.272785 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.272789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.272883 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.272914 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.272975 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.273094 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":2,"thread_start_us":103,"threads_started":1}
I20260807 18:43:48.273276 19311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.266706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36963 (local address 127.0.0.1:60660)
0807 18:43:48.267360 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.267414 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.267547 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.268167 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.268173 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.268196 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.268345 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.268352 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.269737 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.269740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.271228 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.271239 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.272539 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.272543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.272703 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.272799 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.272910 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.273119 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":106,"thread_start_us":107,"threads_started":1}
I20260807 18:43:48.276563 19077 tablet_service.cc:1467] Processing CreateTablet for tablet 50d380c7c623402097df26500828b8c7 (DEFAULT_TABLE table=test-table [id=a187916b26d74bae907624bdf4e074a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:48.276750 19221 tablet_service.cc:1467] Processing CreateTablet for tablet 50d380c7c623402097df26500828b8c7 (DEFAULT_TABLE table=test-table [id=a187916b26d74bae907624bdf4e074a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:48.276665 18932 tablet_service.cc:1467] Processing CreateTablet for tablet 50d380c7c623402097df26500828b8c7 (DEFAULT_TABLE table=test-table [id=a187916b26d74bae907624bdf4e074a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:48.277621 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d380c7c623402097df26500828b8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.277663 18932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d380c7c623402097df26500828b8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.277667 19221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d380c7c623402097df26500828b8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.284785 19317 tablet_bootstrap.cc:492] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Bootstrap starting.
I20260807 18:43:48.285763 19319 tablet_bootstrap.cc:492] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Bootstrap starting.
I20260807 18:43:48.286759 19318 tablet_bootstrap.cc:492] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Bootstrap starting.
I20260807 18:43:48.286789 19317 tablet_bootstrap.cc:654] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.287613 19317 log.cc:824] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:48.287886 19319 tablet_bootstrap.cc:654] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.288659 19318 tablet_bootstrap.cc:654] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.288690 19319 log.cc:824] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:48.289426 19318 log.cc:824] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:48.289559 19317 tablet_bootstrap.cc:492] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: No bootstrap required, opened a new log
I20260807 18:43:48.289754 19317 ts_tablet_manager.cc:1397] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:43:48.290714 19319 tablet_bootstrap.cc:492] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: No bootstrap required, opened a new log
I20260807 18:43:48.290892 19319 ts_tablet_manager.cc:1397] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:48.291482 19318 tablet_bootstrap.cc:492] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: No bootstrap required, opened a new log
I20260807 18:43:48.291648 19318 ts_tablet_manager.cc:1397] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:43:48.292933 19317 raft_consensus.cc:348] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.293159 19317 raft_consensus.cc:374] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.293220 19317 raft_consensus.cc:729] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.293622 19317 consensus_queue.cc:260] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.294262 19145 heartbeater.cc:503] Master 127.10.174.254:39667 was elected leader, sending a full tablet report...
I20260807 18:43:48.294610 19317 ts_tablet_manager.cc:1428] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:43:48.294828 19319 raft_consensus.cc:348] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.295068 19319 raft_consensus.cc:374] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.295123 19319 raft_consensus.cc:729] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.295516 19319 consensus_queue.cc:260] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.296129 19001 heartbeater.cc:503] Master 127.10.174.254:39667 was elected leader, sending a full tablet report...
I20260807 18:43:48.296396 19319 ts_tablet_manager.cc:1428] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:43:48.298794 19318 raft_consensus.cc:348] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.299054 19318 raft_consensus.cc:374] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.299116 19318 raft_consensus.cc:729] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b980563f0fd2477c9bc34b9f6c46e4e5, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.299511 19318 consensus_queue.cc:260] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.300098 19288 heartbeater.cc:503] Master 127.10.174.254:39667 was elected leader, sending a full tablet report...
I20260807 18:43:48.300293 19318 ts_tablet_manager.cc:1428] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 18:43:48.445120 19324 raft_consensus.cc:482] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:48.445325 19324 raft_consensus.cc:504] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.446370 19324 leader_election.cc:288] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857), 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321)
I20260807 18:43:48.450613 19327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.446635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36321 (local address 127.10.174.193:33671)
0807 18:43:48.447090 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.447102 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.447225 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.447609 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.447611 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.447626 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.447715 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.447720 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.448484 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.448487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.449364 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.449373 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.450162 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.450165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.450248 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.450278 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.450365 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.450456 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":38,"thread_start_us":107,"threads_started":1}
I20260807 18:43:48.450620 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.446795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:33671 (local address 127.10.174.194:36321)
0807 18:43:48.446930 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.446936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.447207 (+ 271us) server_negotiation.cc:407] Connection header received
0807 18:43:48.447402 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.447405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.447490 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.447568 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.447851 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.448343 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.449488 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.450039 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.450149 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.450213 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.450410 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.450495 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:43:48.450670 19315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.446892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:40213 (local address 127.10.174.195:43857)
0807 18:43:48.447039 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.447045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.447062 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:43:48.447315 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.447318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.447391 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.447468 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.447790 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.448329 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.449494 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.450064 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.450195 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.450255 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.450483 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.450555 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 18:43:48.450636 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.446635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:43857 (local address 127.10.174.193:40213)
0807 18:43:48.446991 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.447007 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.447121 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.447500 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.447504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.447524 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.447665 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.447673 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.448444 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.448448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.449364 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.449373 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.450199 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.450202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.450305 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.450321 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.450449 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.450509 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":46,"thread_start_us":109,"threads_started":1}
I20260807 18:43:48.451519 19099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d380c7c623402097df26500828b8c7" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dec69e0114549a49d557ae1df9d5288" is_pre_election: true
I20260807 18:43:48.451524 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d380c7c623402097df26500828b8c7" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" is_pre_election: true
I20260807 18:43:48.451802 19099 raft_consensus.cc:2454] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 0.
I20260807 18:43:48.451836 19242 raft_consensus.cc:2454] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 0.
I20260807 18:43:48.452260 18882 leader_election.cc:302] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, cd6830bca6bd41b3960591b4ef186223; no voters:
I20260807 18:43:48.452523 19324 raft_consensus.cc:2781] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:48.452607 19324 raft_consensus.cc:482] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:48.452651 19324 raft_consensus.cc:3037] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.453919 19324 raft_consensus.cc:504] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.454274 19324 leader_election.cc:288] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 election: Requested vote from peers b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857), 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321)
I20260807 18:43:48.454568 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d380c7c623402097df26500828b8c7" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
I20260807 18:43:48.454607 19099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d380c7c623402097df26500828b8c7" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dec69e0114549a49d557ae1df9d5288"
I20260807 18:43:48.454698 19242 raft_consensus.cc:3037] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.454748 19099 raft_consensus.cc:3037] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Advancing to term 1
W20260807 18:43:48.455862 19289 tablet.cc:2369] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:48.455968 19242 raft_consensus.cc:2454] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 1.
I20260807 18:43:48.456106 19099 raft_consensus.cc:2454] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 1.
I20260807 18:43:48.456264 18884 leader_election.cc:302] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b980563f0fd2477c9bc34b9f6c46e4e5, cd6830bca6bd41b3960591b4ef186223; no voters:
I20260807 18:43:48.456450 19324 raft_consensus.cc:2781] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:48.456676 19324 raft_consensus.cc:686] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 1 LEADER]: Becoming Leader. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Running, Role: LEADER
I20260807 18:43:48.456990 19324 consensus_queue.cc:237] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } }
I20260807 18:43:48.460006 18787 catalog_manager.cc:5495] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6830bca6bd41b3960591b4ef186223 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "cd6830bca6bd41b3960591b4ef186223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } health_report { overall_health: UNKNOWN } } }
W20260807 18:43:48.490980 19146 tablet.cc:2369] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:48.506738 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.503187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42284 (local address 127.10.174.193:36963)
0807 18:43:48.503365 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.503372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.503390 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:43:48.503479 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.503481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.503532 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.503645 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:48.503889 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.504491 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.505346 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.505566 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.505677 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.505959 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.506332 (+ 373us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.506452 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.506518 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.506574 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 18:43:48.513115 19242 raft_consensus.cc:1261] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Refusing update from remote peer cd6830bca6bd41b3960591b4ef186223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:48.513370 19099 raft_consensus.cc:1261] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Refusing update from remote peer cd6830bca6bd41b3960591b4ef186223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:48.513971 19324 consensus_queue.cc:1035] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:48.514216 19328 consensus_queue.cc:1035] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:48.521200 19331 mvcc.cc:205] Tried to move back new op lower bound from 7315981223982747648 to 7315981223762231296. Current Snapshot: MvccSnapshot[applied={T|T < 7315981223982747648}]
I20260807 18:43:48.521829 19332 mvcc.cc:205] Tried to move back new op lower bound from 7315981223982747648 to 7315981223762231296. Current Snapshot: MvccSnapshot[applied={T|T < 7315981223982747648}]
I20260807 18:43:48.523918 19333 mvcc.cc:205] Tried to move back new op lower bound from 7315981223982747648 to 7315981223762231296. Current Snapshot: MvccSnapshot[applied={T|T < 7315981223982747648}]
I20260807 18:43:48.529417 18788 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:48.529605 18788 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:48.531920 18788 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Sending DeleteTablet for 3 replicas of tablet 50d380c7c623402097df26500828b8c7
I20260807 18:43:48.532610 19077 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d380c7c623402097df26500828b8c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:48 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:40036
I20260807 18:43:48.532596 19221 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d380c7c623402097df26500828b8c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:48 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:48288
I20260807 18:43:48.533013 19341 tablet_replica.cc:330] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: stopping tablet replica
I20260807 18:43:48.533038 19342 tablet_replica.cc:330] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: stopping tablet replica
I20260807 18:43:48.533051 18932 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d380c7c623402097df26500828b8c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:48 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 18:43:48.533414 19341 raft_consensus.cc:2229] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:48.533737 19341 raft_consensus.cc:2258] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:48.533334 19342 raft_consensus.cc:2229] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:48.534099 18788 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:43:48.534242 19342 raft_consensus.cc:2258] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 18:43:48.534502 18788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:48.535563 19343 tablet_replica.cc:330] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: stopping tablet replica
I20260807 18:43:48.535708 19342 ts_tablet_manager.cc:1905] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:48.535810 19343 raft_consensus.cc:2229] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:48.536140 19343 raft_consensus.cc:2258] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:48.537711 19341 ts_tablet_manager.cc:1905] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:48.538689 19342 ts_tablet_manager.cc:1918] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:48.538805 19342 log.cc:1196] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/50d380c7c623402097df26500828b8c7
I20260807 18:43:48.539136 19342 ts_tablet_manager.cc:1939] T 50d380c7c623402097df26500828b8c7 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting consensus metadata
I20260807 18:43:48.540328 18776 catalog_manager.cc:4841] TS b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857): tablet 50d380c7c623402097df26500828b8c7 (table test-table [id=a187916b26d74bae907624bdf4e074a3]) successfully deleted
I20260807 18:43:48.540786 19341 ts_tablet_manager.cc:1918] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:48.541033 19341 log.cc:1196] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/50d380c7c623402097df26500828b8c7
I20260807 18:43:48.541271 18932 tablet_service.cc:1467] Processing CreateTablet for tablet 8c028cd94b87464dae0348d9dab5cd44 (DEFAULT_TABLE table=test-table [id=e01ae67a103d41238350a07f6788e50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:48.541348 19341 ts_tablet_manager.cc:1939] T 50d380c7c623402097df26500828b8c7 P 9dec69e0114549a49d557ae1df9d5288: Deleting consensus metadata
I20260807 18:43:48.541544 18932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c028cd94b87464dae0348d9dab5cd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.543834 19319 tablet_bootstrap.cc:492] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Bootstrap starting.
I20260807 18:43:48.544382 18773 catalog_manager.cc:4841] TS 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321): tablet 50d380c7c623402097df26500828b8c7 (table test-table [id=a187916b26d74bae907624bdf4e074a3]) successfully deleted
I20260807 18:43:48.544888 19319 tablet_bootstrap.cc:654] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.544920 19077 tablet_service.cc:1467] Processing CreateTablet for tablet 8c028cd94b87464dae0348d9dab5cd44 (DEFAULT_TABLE table=test-table [id=e01ae67a103d41238350a07f6788e50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:48.545154 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c028cd94b87464dae0348d9dab5cd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.545636 19221 tablet_service.cc:1467] Processing CreateTablet for tablet 8c028cd94b87464dae0348d9dab5cd44 (DEFAULT_TABLE table=test-table [id=e01ae67a103d41238350a07f6788e50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:48.545871 19221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c028cd94b87464dae0348d9dab5cd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.547382 19317 tablet_bootstrap.cc:492] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Bootstrap starting.
I20260807 18:43:48.548236 19318 tablet_bootstrap.cc:492] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Bootstrap starting.
I20260807 18:43:48.548249 19317 tablet_bootstrap.cc:654] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.548727 19343 ts_tablet_manager.cc:1905] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:48.549124 19318 tablet_bootstrap.cc:654] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.549700 19317 tablet_bootstrap.cc:492] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: No bootstrap required, opened a new log
I20260807 18:43:48.549767 19317 ts_tablet_manager.cc:1397] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:48.550196 19317 raft_consensus.cc:348] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.550315 19317 raft_consensus.cc:374] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.550346 19317 raft_consensus.cc:729] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.550455 19317 consensus_queue.cc:260] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.550659 19319 tablet_bootstrap.cc:492] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: No bootstrap required, opened a new log
I20260807 18:43:48.550697 19317 ts_tablet_manager.cc:1428] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:48.550730 19319 ts_tablet_manager.cc:1397] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 18:43:48.551194 19319 raft_consensus.cc:348] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.551340 19319 raft_consensus.cc:374] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.551379 19319 raft_consensus.cc:729] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.551453 19343 ts_tablet_manager.cc:1918] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:48.551527 19343 log.cc:1196] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/50d380c7c623402097df26500828b8c7
I20260807 18:43:48.551489 19319 consensus_queue.cc:260] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.551819 19319 ts_tablet_manager.cc:1428] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:48.551855 19343 ts_tablet_manager.cc:1939] T 50d380c7c623402097df26500828b8c7 P cd6830bca6bd41b3960591b4ef186223: Deleting consensus metadata
I20260807 18:43:48.553838 19318 tablet_bootstrap.cc:492] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: No bootstrap required, opened a new log
I20260807 18:43:48.553943 19318 ts_tablet_manager.cc:1397] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260807 18:43:48.554282 18773 catalog_manager.cc:4841] TS cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963): tablet 50d380c7c623402097df26500828b8c7 (table test-table [id=a187916b26d74bae907624bdf4e074a3]) successfully deleted
I20260807 18:43:48.554384 19318 raft_consensus.cc:348] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.554497 19318 raft_consensus.cc:374] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.554540 19318 raft_consensus.cc:729] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b980563f0fd2477c9bc34b9f6c46e4e5, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.554675 19318 consensus_queue.cc:260] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.554939 19318 ts_tablet_manager.cc:1428] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:48.621421 19323 raft_consensus.cc:482] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:48.621562 19323 raft_consensus.cc:504] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.622598 19323 leader_election.cc:288] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963), b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:48.627359 19315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.623071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:44099 (local address 127.10.174.195:43857)
0807 18:43:48.623196 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.623203 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.623423 (+ 220us) server_negotiation.cc:407] Connection header received
0807 18:43:48.623592 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.623596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.623642 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.623707 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.624076 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.624544 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.626212 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.626727 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.626806 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.626845 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.627121 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.627225 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:48.627422 19348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.622831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:43857 (local address 127.10.174.194:44099)
0807 18:43:48.623348 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.623360 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.623485 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.623820 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.623823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.623843 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.623956 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.623961 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.624652 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.624658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.626070 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.626081 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.626922 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.626925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.626999 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.627014 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.627100 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.627203 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":93,"thread_start_us":116,"threads_started":1}
I20260807 18:43:48.627923 19347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.622821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36963 (local address 127.10.174.194:45443)
0807 18:43:48.623194 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.623209 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.623348 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.623609 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.623612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.623624 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.623772 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.623781 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.624717 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.624720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.626401 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.626410 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.627450 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.627454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.627564 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.627585 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.627699 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.627770 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":68,"thread_start_us":75,"threads_started":1}
I20260807 18:43:48.627945 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.623088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:45443 (local address 127.10.174.193:36963)
0807 18:43:48.623233 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.623238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.623298 (+ 60us) server_negotiation.cc:407] Connection header received
0807 18:43:48.623467 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.623470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.623520 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.623594 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.623877 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.624622 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.626516 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.627121 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.627282 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.627369 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.627757 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.627839 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 18:43:48.628121 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c028cd94b87464dae0348d9dab5cd44" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" is_pre_election: true
I20260807 18:43:48.628273 19242 raft_consensus.cc:2454] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 0.
I20260807 18:43:48.628415 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c028cd94b87464dae0348d9dab5cd44" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6830bca6bd41b3960591b4ef186223" is_pre_election: true
I20260807 18:43:48.628680 18952 raft_consensus.cc:2454] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 0.
I20260807 18:43:48.628682 19029 leader_election.cc:302] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, b980563f0fd2477c9bc34b9f6c46e4e5; no voters:
I20260807 18:43:48.628955 19323 raft_consensus.cc:2781] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:48.629043 19323 raft_consensus.cc:482] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:48.629093 19323 raft_consensus.cc:3037] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.630280 19323 raft_consensus.cc:504] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.630678 19323 leader_election.cc:288] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 election: Requested vote from peers cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963), b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:48.631026 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c028cd94b87464dae0348d9dab5cd44" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
I20260807 18:43:48.631028 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c028cd94b87464dae0348d9dab5cd44" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6830bca6bd41b3960591b4ef186223"
I20260807 18:43:48.631161 19242 raft_consensus.cc:3037] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.631171 18952 raft_consensus.cc:3037] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.632061 19242 raft_consensus.cc:2454] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 1.
I20260807 18:43:48.632341 19029 leader_election.cc:302] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, b980563f0fd2477c9bc34b9f6c46e4e5; no voters:
I20260807 18:43:48.632398 18952 raft_consensus.cc:2454] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 1.
I20260807 18:43:48.632532 19323 raft_consensus.cc:2781] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:48.632781 19323 raft_consensus.cc:686] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 1 LEADER]: Becoming Leader. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Running, Role: LEADER
I20260807 18:43:48.633024 19323 consensus_queue.cc:237] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.635640 18789 catalog_manager.cc:5495] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194). New cstate: current_term: 1 leader_uuid: "9dec69e0114549a49d557ae1df9d5288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } health_report { overall_health: UNKNOWN } } }
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128227, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.254@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:48.677333 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.668810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59650 (local address 127.10.174.254:39667)
0807 18:43:48.668930 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.668935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.669111 (+ 176us) server_negotiation.cc:407] Connection header received
0807 18:43:48.669240 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.669244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.669287 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.669394 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.670068 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.670738 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.671594 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.671809 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.671916 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.674276 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:48.674280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:48.674289 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:48.674309 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:48.675694 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.676145 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.676151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.676153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.676226 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.676491 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.676497 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.676499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.676656 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:48.676767 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.677039 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.677191 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":44}
I20260807 18:43:48.677333 19356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.668732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39667 (local address 127.0.0.1:59650)
0807 18:43:48.669022 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.669038 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.669146 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.669439 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.669442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.669870 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:48.669956 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.669963 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.670874 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.670879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.671484 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.671493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.671922 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.671925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.672001 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.672580 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:48.672591 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:48.674150 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:48.675809 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.675819 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.675825 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.676046 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.676321 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:48.676324 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:48.676326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:48.676407 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:48.676767 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:48.676775 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:48.676881 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.676995 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.677139 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":96,"threads_started":1}
I20260807 18:43:48.681612 18789 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:59650:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 18:43:48.682341 18789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:48.687181 18932 tablet_service.cc:1467] Processing CreateTablet for tablet 4e10efc416d340c3b867de543ad4f0e5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4029a3a3eb3647449632f684a1f0cd34]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:48.687619 18932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e10efc416d340c3b867de543ad4f0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.687557 19221 tablet_service.cc:1467] Processing CreateTablet for tablet 4e10efc416d340c3b867de543ad4f0e5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4029a3a3eb3647449632f684a1f0cd34]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:48.687891 19221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e10efc416d340c3b867de543ad4f0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.690428 19319 tablet_bootstrap.cc:492] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: Bootstrap starting.
I20260807 18:43:48.690577 19318 tablet_bootstrap.cc:492] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: Bootstrap starting.
I20260807 18:43:48.690650 19077 tablet_service.cc:1467] Processing CreateTablet for tablet 4e10efc416d340c3b867de543ad4f0e5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4029a3a3eb3647449632f684a1f0cd34]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 18:43:48.691068 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e10efc416d340c3b867de543ad4f0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:48.691375 19319 tablet_bootstrap.cc:654] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.691610 19318 tablet_bootstrap.cc:654] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.692797 19319 tablet_bootstrap.cc:492] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: No bootstrap required, opened a new log
I20260807 18:43:48.692873 19318 tablet_bootstrap.cc:492] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: No bootstrap required, opened a new log
I20260807 18:43:48.692889 19319 ts_tablet_manager.cc:1397] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 18:43:48.692956 19318 ts_tablet_manager.cc:1397] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:48.693266 19319 raft_consensus.cc:348] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.693395 19319 raft_consensus.cc:374] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.693429 19319 raft_consensus.cc:729] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.693423 19318 raft_consensus.cc:348] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.693542 19318 raft_consensus.cc:374] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.693579 19318 raft_consensus.cc:729] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b980563f0fd2477c9bc34b9f6c46e4e5, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.693570 19319 consensus_queue.cc:260] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.693712 19318 consensus_queue.cc:260] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.693854 19319 ts_tablet_manager.cc:1428] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:48.693827 19336 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.693946 19336 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:48.693992 19318 ts_tablet_manager.cc:1428] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 18:43:48.694089 19325 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.694221 19325 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:48.694545 19317 tablet_bootstrap.cc:492] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: Bootstrap starting.
I20260807 18:43:48.695578 19317 tablet_bootstrap.cc:654] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:48.696760 19317 tablet_bootstrap.cc:492] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: No bootstrap required, opened a new log
I20260807 18:43:48.696859 19317 ts_tablet_manager.cc:1397] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:48.697216 19317 raft_consensus.cc:348] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.697324 19317 raft_consensus.cc:374] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:48.697367 19317 raft_consensus.cc:729] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Initialized, Role: FOLLOWER
I20260807 18:43:48.697494 19317 consensus_queue.cc:260] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.697777 19317 ts_tablet_manager.cc:1428] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:48.697968 19323 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.698089 19323 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 18:43:48.784164 19002 tablet.cc:2369] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:43:48.803411 19325 raft_consensus.cc:482] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:48.803535 19325 raft_consensus.cc:504] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.804559 19325 leader_election.cc:288] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963), 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321)
I20260807 18:43:48.809440 19364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.805191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36321 (local address 127.10.174.195:40899)
0807 18:43:48.805518 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.805530 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.805617 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.805854 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.805856 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.805870 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.805947 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.805952 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.806828 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.806831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.808097 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.808107 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.809008 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.809011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.809108 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.809129 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.809194 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.809248 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":102,"thread_start_us":69,"threads_started":1}
I20260807 18:43:48.809445 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.805337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:40899 (local address 127.10.174.194:36321)
0807 18:43:48.805472 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.805478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.805613 (+ 135us) server_negotiation.cc:407] Connection header received
0807 18:43:48.805695 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.805697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.805733 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.805826 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.806053 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.806737 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.808282 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.808885 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.809010 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.809060 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.809231 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.809320 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 18:43:48.809659 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.804852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:39419 (local address 127.10.174.193:36963)
0807 18:43:48.804987 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.804992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.805144 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:43:48.805365 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.805371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.805420 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.805497 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:43:48.805794 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.806554 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.808270 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.808885 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.809013 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.809060 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.809427 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.809520 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:43:48.809724 19361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.804801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36963 (local address 127.10.174.195:39419)
0807 18:43:48.805047 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.805060 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.805192 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.805526 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.805530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.805552 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:43:48.805689 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.805698 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.806663 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.806665 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.808097 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.808107 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.809123 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.809126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.809258 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.809281 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.809353 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.809423 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":69,"thread_start_us":92,"threads_started":1}
I20260807 18:43:48.809824 19099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e10efc416d340c3b867de543ad4f0e5" candidate_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dec69e0114549a49d557ae1df9d5288" is_pre_election: true
I20260807 18:43:48.809971 19099 raft_consensus.cc:2454] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b980563f0fd2477c9bc34b9f6c46e4e5 in term 0.
I20260807 18:43:48.810134 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e10efc416d340c3b867de543ad4f0e5" candidate_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6830bca6bd41b3960591b4ef186223" is_pre_election: true
I20260807 18:43:48.810295 18952 raft_consensus.cc:2454] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b980563f0fd2477c9bc34b9f6c46e4e5 in term 0.
I20260807 18:43:48.810322 19171 leader_election.cc:302] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, b980563f0fd2477c9bc34b9f6c46e4e5; no voters:
I20260807 18:43:48.810624 19325 raft_consensus.cc:2781] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:48.810710 19325 raft_consensus.cc:482] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:48.810766 19325 raft_consensus.cc:3037] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.811869 19325 raft_consensus.cc:504] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.812189 19325 leader_election.cc:288] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [CANDIDATE]: Term 1 election: Requested vote from peers cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963), 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321)
I20260807 18:43:48.812523 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e10efc416d340c3b867de543ad4f0e5" candidate_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6830bca6bd41b3960591b4ef186223"
I20260807 18:43:48.812597 19099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e10efc416d340c3b867de543ad4f0e5" candidate_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dec69e0114549a49d557ae1df9d5288"
I20260807 18:43:48.812659 18952 raft_consensus.cc:3037] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.812729 19099 raft_consensus.cc:3037] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:48.813532 18952 raft_consensus.cc:2454] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b980563f0fd2477c9bc34b9f6c46e4e5 in term 1.
I20260807 18:43:48.813653 19099 raft_consensus.cc:2454] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b980563f0fd2477c9bc34b9f6c46e4e5 in term 1.
I20260807 18:43:48.813799 19171 leader_election.cc:302] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b980563f0fd2477c9bc34b9f6c46e4e5, cd6830bca6bd41b3960591b4ef186223; no voters:
I20260807 18:43:48.813966 19325 raft_consensus.cc:2781] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:48.814131 19325 raft_consensus.cc:686] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 LEADER]: Becoming Leader. State: Replica: b980563f0fd2477c9bc34b9f6c46e4e5, State: Running, Role: LEADER
I20260807 18:43:48.814363 19325 consensus_queue.cc:237] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:48.816015 19365 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: TxnStatusTablet state changed. Reason: New leader b980563f0fd2477c9bc34b9f6c46e4e5. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.816136 19365 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:48.816425 19367 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 18:43:48.816579 19367 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 18:43:48.817070 18787 catalog_manager.cc:5495] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } health_report { overall_health: HEALTHY } } }
I20260807 18:43:48.846760 19356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.843137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:43857 (local address 127.0.0.1:32908)
0807 18:43:48.843273 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.843308 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.843427 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.843719 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.843722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.843729 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:48.843848 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.843853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.844648 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.844653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.845234 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.845242 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.845700 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.845704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.845799 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.845839 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.846458 (+ 619us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.846475 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.846549 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.846631 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 18:43:48.846764 19315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.843258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32908 (local address 127.10.174.195:43857)
0807 18:43:48.843440 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.843444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.843458 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:48.843549 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.843552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.843609 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.843708 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:48.843953 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.844539 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.845362 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.845588 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.845700 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.845984 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.846360 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.846478 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.846575 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.846627 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 18:43:48.849742 19099 raft_consensus.cc:1261] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Refusing update from remote peer b980563f0fd2477c9bc34b9f6c46e4e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:48.849953 18952 raft_consensus.cc:1261] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Refusing update from remote peer b980563f0fd2477c9bc34b9f6c46e4e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:48.850302 19325 consensus_queue.cc:1035] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:48.850472 19365 consensus_queue.cc:1035] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:48.852005 19323 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: TxnStatusTablet state changed. Reason: New leader b980563f0fd2477c9bc34b9f6c46e4e5. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.852051 19336 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: TxnStatusTablet state changed. Reason: New leader b980563f0fd2477c9bc34b9f6c46e4e5. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.852128 19323 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:48.852150 19336 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:48.855085 19325 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.855232 19325 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:48.856161 19336 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.856276 19336 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P cd6830bca6bd41b3960591b4ef186223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:48.857331 19373 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.857453 19373 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P b980563f0fd2477c9bc34b9f6c46e4e5: This TxnStatusTablet replica's current role is: LEADER
I20260807 18:43:48.857530 19323 tablet_replica.cc:439] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } } }
I20260807 18:43:48.857637 19323 tablet_replica.cc:442] T 4e10efc416d340c3b867de543ad4f0e5 P 9dec69e0114549a49d557ae1df9d5288: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 18:43:48.863417 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.859796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38474 (local address 127.10.174.194:36321)
0807 18:43:48.859925 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.859929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.859979 (+ 50us) server_negotiation.cc:407] Connection header received
0807 18:43:48.860127 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.860129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.860173 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.860275 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:48.860513 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.860986 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.862112 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.862313 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.862385 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.862650 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.863011 (+ 361us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.863093 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.863194 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.863234 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 18:43:48.873845 19315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.869819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:60769 (local address 127.10.174.195:43857)
0807 18:43:48.869946 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.869951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.870199 (+ 248us) server_negotiation.cc:407] Connection header received
0807 18:43:48.870324 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.870326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.870362 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.870455 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:48.870668 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.871152 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.872879 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.873102 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.873175 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.873477 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.873534 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.873587 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.873715 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.873755 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:43:48.873927 19376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.869745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:43857 (local address 127.10.174.194:60769)
0807 18:43:48.870118 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.870132 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.870228 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.870462 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.870464 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.870471 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:48.870574 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.870580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.871253 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.871256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.872754 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.872765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.873207 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.873211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.873306 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.873351 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.873615 (+ 264us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.873621 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.873694 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.873767 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":119,"threads_started":1}
I20260807 18:43:48.880558 19242 raft_consensus.cc:1261] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Refusing update from remote peer 9dec69e0114549a49d557ae1df9d5288: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:48.880612 18952 raft_consensus.cc:1261] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Refusing update from remote peer 9dec69e0114549a49d557ae1df9d5288: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:48.881073 19349 consensus_queue.cc:1035] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:48.881263 19323 consensus_queue.cc:1035] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:48.902984 19381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.899119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36321 (local address 127.10.174.195:37567)
0807 18:43:48.899458 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:48.899471 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:48.899556 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:48.899773 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:48.899775 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:48.899780 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:48.899907 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.899914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.900950 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.900952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.901771 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:48.901781 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.902284 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.902289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:48.902370 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.902412 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.902701 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.902710 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 18:43:48.902771 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 18:43:48.902846 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":128,"threads_started":1}
I20260807 18:43:48.902963 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.899206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:37567 (local address 127.10.174.194:36321)
0807 18:43:48.899334 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.899338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.899542 (+ 204us) server_negotiation.cc:407] Connection header received
0807 18:43:48.899625 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.899630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.899690 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.899771 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:48.900070 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.900667 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.901892 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.902129 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.902239 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.902542 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:48.902620 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:48.902698 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.902790 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.902837 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:43:48.930166 18787 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:48.930335 18787 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:48.932593 18787 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Sending DeleteTablet for 3 replicas of tablet 8c028cd94b87464dae0348d9dab5cd44
I20260807 18:43:48.933182 18932 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c028cd94b87464dae0348d9dab5cd44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:48 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 18:43:48.933323 19077 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c028cd94b87464dae0348d9dab5cd44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:48 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:40036
I20260807 18:43:48.933377 19343 tablet_replica.cc:330] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: stopping tablet replica
I20260807 18:43:48.933492 19341 tablet_replica.cc:330] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: stopping tablet replica
I20260807 18:43:48.933490 19343 raft_consensus.cc:2229] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:48.933624 19343 raft_consensus.cc:2258] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:48.933596 19341 raft_consensus.cc:2229] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:48.933816 19221 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c028cd94b87464dae0348d9dab5cd44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:48 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:48288
I20260807 18:43:48.933907 19341 raft_consensus.cc:2258] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:48.933990 19342 tablet_replica.cc:330] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: stopping tablet replica
I20260807 18:43:48.934101 19342 raft_consensus.cc:2229] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:48.934218 19342 raft_consensus.cc:2258] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:48.934736 19341 ts_tablet_manager.cc:1905] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:48.934971 19342 ts_tablet_manager.cc:1905] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:48.937593 19341 ts_tablet_manager.cc:1918] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:48.937660 19341 log.cc:1196] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/8c028cd94b87464dae0348d9dab5cd44
I20260807 18:43:48.937875 19342 ts_tablet_manager.cc:1918] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:48.937942 19342 log.cc:1196] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/8c028cd94b87464dae0348d9dab5cd44
I20260807 18:43:48.937947 19341 ts_tablet_manager.cc:1939] T 8c028cd94b87464dae0348d9dab5cd44 P 9dec69e0114549a49d557ae1df9d5288: Deleting consensus metadata
I20260807 18:43:48.938206 19342 ts_tablet_manager.cc:1939] T 8c028cd94b87464dae0348d9dab5cd44 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting consensus metadata
I20260807 18:43:48.938719 18773 catalog_manager.cc:4841] TS 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321): tablet 8c028cd94b87464dae0348d9dab5cd44 (table test-table [id=e01ae67a103d41238350a07f6788e50a]) successfully deleted
I20260807 18:43:48.938827 18776 catalog_manager.cc:4841] TS b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857): tablet 8c028cd94b87464dae0348d9dab5cd44 (table test-table [id=e01ae67a103d41238350a07f6788e50a]) successfully deleted
I20260807 18:43:48.939478 19343 ts_tablet_manager.cc:1905] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:48.942081 19343 ts_tablet_manager.cc:1918] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:48.942147 19343 log.cc:1196] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/8c028cd94b87464dae0348d9dab5cd44
I20260807 18:43:48.942408 19343 ts_tablet_manager.cc:1939] T 8c028cd94b87464dae0348d9dab5cd44 P cd6830bca6bd41b3960591b4ef186223: Deleting consensus metadata
I20260807 18:43:48.943399 18773 catalog_manager.cc:4841] TS cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963): tablet 8c028cd94b87464dae0348d9dab5cd44 (table test-table [id=e01ae67a103d41238350a07f6788e50a]) successfully deleted
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128228, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 18:43:48.974040 18839 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:48.966089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59662 (local address 127.10.174.254:39667)
0807 18:43:48.966225 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.966230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.966518 (+ 288us) server_negotiation.cc:407] Connection header received
0807 18:43:48.966654 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.966657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.966710 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.966801 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.967816 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.968639 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.969860 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.970217 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.970318 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.973917 (+ 3599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59662: BlockingRecv error: recv got EOF from 127.0.0.1:59662 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 18:43:48 dist-test-slave-07c2 krb5kdc[18742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128228, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM
I20260807 18:43:48.988245 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:48.975729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59664 (local address 127.10.174.254:39667)
0807 18:43:48.976100 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:48.976104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:48.978339 (+ 2235us) server_negotiation.cc:407] Connection header received
0807 18:43:48.978438 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:48.978441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:48.978484 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:48.978565 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:48.979281 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.980088 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.981198 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:48.981538 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:48.981642 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:48.984555 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:48.984559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:48.984562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:48.984588 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:48.986264 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.986723 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.986726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.986728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.986814 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:48.987181 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:48.987184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:48.987186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:48.987435 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:48.987566 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:48.987806 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 18:43:48.987915 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297}
I20260807 18:43:48.995193 18787 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:43:48.995667 18787 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:49.000746 18932 tablet_service.cc:1467] Processing CreateTablet for tablet ca6e377d292c4a0b8754a32ee1a37fa3 (DEFAULT_TABLE table=test-table [id=b6b5fb00dc194fdab1d4f2591381f1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:49.000891 19221 tablet_service.cc:1467] Processing CreateTablet for tablet ca6e377d292c4a0b8754a32ee1a37fa3 (DEFAULT_TABLE table=test-table [id=b6b5fb00dc194fdab1d4f2591381f1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:49.001029 18932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca6e377d292c4a0b8754a32ee1a37fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:49.001160 19221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca6e377d292c4a0b8754a32ee1a37fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:49.003404 19319 tablet_bootstrap.cc:492] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Bootstrap starting.
I20260807 18:43:49.003492 19318 tablet_bootstrap.cc:492] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Bootstrap starting.
I20260807 18:43:49.004069 19077 tablet_service.cc:1467] Processing CreateTablet for tablet ca6e377d292c4a0b8754a32ee1a37fa3 (DEFAULT_TABLE table=test-table [id=b6b5fb00dc194fdab1d4f2591381f1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:49.004248 19319 tablet_bootstrap.cc:654] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:49.004269 19318 tablet_bootstrap.cc:654] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:49.004354 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca6e377d292c4a0b8754a32ee1a37fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:49.006094 19318 tablet_bootstrap.cc:492] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: No bootstrap required, opened a new log
I20260807 18:43:49.006178 19318 ts_tablet_manager.cc:1397] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 18:43:49.006587 19318 raft_consensus.cc:348] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.006698 19318 raft_consensus.cc:374] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:49.006737 19318 raft_consensus.cc:729] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b980563f0fd2477c9bc34b9f6c46e4e5, State: Initialized, Role: FOLLOWER
I20260807 18:43:49.006767 19317 tablet_bootstrap.cc:492] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Bootstrap starting.
I20260807 18:43:49.006882 19318 consensus_queue.cc:260] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.007157 19318 ts_tablet_manager.cc:1428] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:49.007625 19317 tablet_bootstrap.cc:654] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:49.008958 19317 tablet_bootstrap.cc:492] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: No bootstrap required, opened a new log
I20260807 18:43:49.009033 19317 ts_tablet_manager.cc:1397] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:49.009696 19317 raft_consensus.cc:348] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.009786 19317 raft_consensus.cc:374] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:49.009812 19317 raft_consensus.cc:729] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Initialized, Role: FOLLOWER
I20260807 18:43:49.009913 19317 consensus_queue.cc:260] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.010123 19317 ts_tablet_manager.cc:1428] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:49.010684 19319 tablet_bootstrap.cc:492] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: No bootstrap required, opened a new log
I20260807 18:43:49.010759 19319 ts_tablet_manager.cc:1397] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 18:43:49.011087 19319 raft_consensus.cc:348] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.011175 19319 raft_consensus.cc:374] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:49.011202 19319 raft_consensus.cc:729] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Initialized, Role: FOLLOWER
I20260807 18:43:49.011631 19319 consensus_queue.cc:260] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.011909 19319 ts_tablet_manager.cc:1428] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:49.131817 19379 raft_consensus.cc:482] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:49.131942 19379 raft_consensus.cc:504] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.132290 19379 leader_election.cc:288] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963), b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:49.132695 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6e377d292c4a0b8754a32ee1a37fa3" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" is_pre_election: true
I20260807 18:43:49.132720 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6e377d292c4a0b8754a32ee1a37fa3" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6830bca6bd41b3960591b4ef186223" is_pre_election: true
I20260807 18:43:49.132863 19242 raft_consensus.cc:2454] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 0.
I20260807 18:43:49.132881 18952 raft_consensus.cc:2454] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 0.
I20260807 18:43:49.133203 19027 leader_election.cc:302] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, cd6830bca6bd41b3960591b4ef186223; no voters:
I20260807 18:43:49.133401 19379 raft_consensus.cc:2781] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:49.133460 19379 raft_consensus.cc:482] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:49.133487 19379 raft_consensus.cc:3037] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:49.134490 19379 raft_consensus.cc:504] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.134853 19379 leader_election.cc:288] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 election: Requested vote from peers cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963), b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:49.135139 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6e377d292c4a0b8754a32ee1a37fa3" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd6830bca6bd41b3960591b4ef186223"
I20260807 18:43:49.135195 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6e377d292c4a0b8754a32ee1a37fa3" candidate_uuid: "9dec69e0114549a49d557ae1df9d5288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
I20260807 18:43:49.135284 18952 raft_consensus.cc:3037] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:49.135345 19242 raft_consensus.cc:3037] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:49.136199 19242 raft_consensus.cc:2454] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 1.
I20260807 18:43:49.136204 18952 raft_consensus.cc:2454] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dec69e0114549a49d557ae1df9d5288 in term 1.
I20260807 18:43:49.136489 19029 leader_election.cc:302] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, b980563f0fd2477c9bc34b9f6c46e4e5; no voters:
I20260807 18:43:49.136687 19379 raft_consensus.cc:2781] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:49.136790 19379 raft_consensus.cc:686] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 1 LEADER]: Becoming Leader. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Running, Role: LEADER
I20260807 18:43:49.136930 19379 consensus_queue.cc:237] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.138589 18787 catalog_manager.cc:5495] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194). New cstate: current_term: 1 leader_uuid: "9dec69e0114549a49d557ae1df9d5288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:49.164469 19316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.161697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38482 (local address 127.10.174.194:36321)
0807 18:43:49.161814 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:49.161817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:49.161830 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:43:49.161945 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:49.161947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:49.161988 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:49.162053 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:49.162349 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.162821 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.163635 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.163837 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.163908 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:49.164128 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:49.164193 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:49.164245 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:49.164326 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 18:43:49.164373 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 18:43:49.166311 19242 raft_consensus.cc:1261] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Refusing update from remote peer 9dec69e0114549a49d557ae1df9d5288: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:49.166357 18952 raft_consensus.cc:1261] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Refusing update from remote peer 9dec69e0114549a49d557ae1df9d5288: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:49.166702 19379 consensus_queue.cc:1035] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:49.166882 19323 consensus_queue.cc:1035] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:49.174463 18789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:49.174597 18789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:49.176362 18789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Sending DeleteTablet for 3 replicas of tablet ca6e377d292c4a0b8754a32ee1a37fa3
I20260807 18:43:49.176957 19077 tablet_service.cc:1514] Processing DeleteTablet for tablet ca6e377d292c4a0b8754a32ee1a37fa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:49 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:40036
I20260807 18:43:49.176975 18932 tablet_service.cc:1514] Processing DeleteTablet for tablet ca6e377d292c4a0b8754a32ee1a37fa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:49 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 18:43:49.177160 19221 tablet_service.cc:1514] Processing DeleteTablet for tablet ca6e377d292c4a0b8754a32ee1a37fa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:49 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:48288
I20260807 18:43:49.177372 19343 tablet_replica.cc:330] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: stopping tablet replica
I20260807 18:43:49.177374 19342 tablet_replica.cc:330] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: stopping tablet replica
I20260807 18:43:49.177513 19342 raft_consensus.cc:2229] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:49.177522 19343 raft_consensus.cc:2229] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:49.177639 19342 raft_consensus.cc:2258] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:49.177647 19343 raft_consensus.cc:2258] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:49.177605 18789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 18:43:49.177814 19341 tablet_replica.cc:330] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: stopping tablet replica
I20260807 18:43:49.177924 19341 raft_consensus.cc:2229] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 1 LEADER]: Raft consensus shutting down.
W20260807 18:43:49.177975 18789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:43:49.178112 19341 raft_consensus.cc:2258] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:49.178704 19341 ts_tablet_manager.cc:1905] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:49.179924 19342 ts_tablet_manager.cc:1905] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:49.179924 19343 ts_tablet_manager.cc:1905] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:49.181272 19341 ts_tablet_manager.cc:1918] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:49.181349 19341 log.cc:1196] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/ca6e377d292c4a0b8754a32ee1a37fa3
I20260807 18:43:49.181651 19341 ts_tablet_manager.cc:1939] T ca6e377d292c4a0b8754a32ee1a37fa3 P 9dec69e0114549a49d557ae1df9d5288: Deleting consensus metadata
I20260807 18:43:49.182271 19343 ts_tablet_manager.cc:1918] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:49.182271 19342 ts_tablet_manager.cc:1918] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:43:49.182339 19343 log.cc:1196] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/ca6e377d292c4a0b8754a32ee1a37fa3
I20260807 18:43:49.182339 19342 log.cc:1196] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/ca6e377d292c4a0b8754a32ee1a37fa3
I20260807 18:43:49.182348 18773 catalog_manager.cc:4841] TS 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321): tablet ca6e377d292c4a0b8754a32ee1a37fa3 (table test-table [id=b6b5fb00dc194fdab1d4f2591381f1d0]) successfully deleted
I20260807 18:43:49.182593 19342 ts_tablet_manager.cc:1939] T ca6e377d292c4a0b8754a32ee1a37fa3 P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting consensus metadata
I20260807 18:43:49.182593 19343 ts_tablet_manager.cc:1939] T ca6e377d292c4a0b8754a32ee1a37fa3 P cd6830bca6bd41b3960591b4ef186223: Deleting consensus metadata
I20260807 18:43:49.182890 19077 tablet_service.cc:1467] Processing CreateTablet for tablet b6edbdb2ca0346baaf1e9c3f8606b54b (DEFAULT_TABLE table=test-table [id=a0e37206ae4349c8adb32cafeb45644c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:49.183146 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6edbdb2ca0346baaf1e9c3f8606b54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:49.183209 18776 catalog_manager.cc:4841] TS b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857): tablet ca6e377d292c4a0b8754a32ee1a37fa3 (table test-table [id=b6b5fb00dc194fdab1d4f2591381f1d0]) successfully deleted
I20260807 18:43:49.185165 19317 tablet_bootstrap.cc:492] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Bootstrap starting.
I20260807 18:43:49.185307 19221 tablet_service.cc:1467] Processing CreateTablet for tablet b6edbdb2ca0346baaf1e9c3f8606b54b (DEFAULT_TABLE table=test-table [id=a0e37206ae4349c8adb32cafeb45644c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:49.185535 19221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6edbdb2ca0346baaf1e9c3f8606b54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:49.185938 19317 tablet_bootstrap.cc:654] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:49.186964 19317 tablet_bootstrap.cc:492] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: No bootstrap required, opened a new log
I20260807 18:43:49.187029 19317 ts_tablet_manager.cc:1397] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:49.187494 19317 raft_consensus.cc:348] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.187602 19317 raft_consensus.cc:374] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:49.187698 19318 tablet_bootstrap.cc:492] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Bootstrap starting.
I20260807 18:43:49.187642 19317 raft_consensus.cc:729] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dec69e0114549a49d557ae1df9d5288, State: Initialized, Role: FOLLOWER
I20260807 18:43:49.187947 18773 catalog_manager.cc:4841] TS cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963): tablet ca6e377d292c4a0b8754a32ee1a37fa3 (table test-table [id=b6b5fb00dc194fdab1d4f2591381f1d0]) successfully deleted
I20260807 18:43:49.188076 18932 tablet_service.cc:1467] Processing CreateTablet for tablet b6edbdb2ca0346baaf1e9c3f8606b54b (DEFAULT_TABLE table=test-table [id=a0e37206ae4349c8adb32cafeb45644c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:43:49.188318 18932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6edbdb2ca0346baaf1e9c3f8606b54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:49.188476 19318 tablet_bootstrap.cc:654] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:49.189507 19318 tablet_bootstrap.cc:492] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: No bootstrap required, opened a new log
I20260807 18:43:49.189600 19318 ts_tablet_manager.cc:1397] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:49.189982 19318 raft_consensus.cc:348] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.190094 19318 raft_consensus.cc:374] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:49.190125 19318 raft_consensus.cc:729] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b980563f0fd2477c9bc34b9f6c46e4e5, State: Initialized, Role: FOLLOWER
I20260807 18:43:49.190259 19318 consensus_queue.cc:260] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.190555 19318 ts_tablet_manager.cc:1428] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:43:49.190568 19319 tablet_bootstrap.cc:492] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: Bootstrap starting.
I20260807 18:43:49.190809 19317 consensus_queue.cc:260] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.191469 19319 tablet_bootstrap.cc:654] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:49.191499 19317 ts_tablet_manager.cc:1428] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260807 18:43:49.192947 19319 tablet_bootstrap.cc:492] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: No bootstrap required, opened a new log
I20260807 18:43:49.193041 19319 ts_tablet_manager.cc:1397] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 18:43:49.193416 19319 raft_consensus.cc:348] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.193553 19319 raft_consensus.cc:374] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:49.193579 19319 raft_consensus.cc:729] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Initialized, Role: FOLLOWER
I20260807 18:43:49.193717 19319 consensus_queue.cc:260] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.194008 19319 ts_tablet_manager.cc:1428] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 18:43:49.520663 19336 raft_consensus.cc:482] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:43:49.520824 19336 raft_consensus.cc:504] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.521318 19336 leader_election.cc:288] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321), b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:49.521809 19099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6edbdb2ca0346baaf1e9c3f8606b54b" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dec69e0114549a49d557ae1df9d5288" is_pre_election: true
I20260807 18:43:49.521848 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6edbdb2ca0346baaf1e9c3f8606b54b" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" is_pre_election: true
I20260807 18:43:49.521975 19099 raft_consensus.cc:2454] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 0.
I20260807 18:43:49.522006 19242 raft_consensus.cc:2454] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 0.
I20260807 18:43:49.522344 18882 leader_election.cc:302] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, cd6830bca6bd41b3960591b4ef186223; no voters:
I20260807 18:43:49.522511 19336 raft_consensus.cc:2781] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:43:49.522572 19336 raft_consensus.cc:482] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:43:49.522610 19336 raft_consensus.cc:3037] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:49.523679 19336 raft_consensus.cc:504] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.523999 19336 leader_election.cc:288] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 election: Requested vote from peers 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321), b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857)
I20260807 18:43:49.524322 19099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6edbdb2ca0346baaf1e9c3f8606b54b" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dec69e0114549a49d557ae1df9d5288"
I20260807 18:43:49.524382 19242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6edbdb2ca0346baaf1e9c3f8606b54b" candidate_uuid: "cd6830bca6bd41b3960591b4ef186223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5"
I20260807 18:43:49.524451 19099 raft_consensus.cc:3037] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:49.524484 19242 raft_consensus.cc:3037] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:49.525568 19242 raft_consensus.cc:2454] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 1.
I20260807 18:43:49.525568 19099 raft_consensus.cc:2454] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd6830bca6bd41b3960591b4ef186223 in term 1.
I20260807 18:43:49.525889 18882 leader_election.cc:302] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9dec69e0114549a49d557ae1df9d5288, cd6830bca6bd41b3960591b4ef186223; no voters:
I20260807 18:43:49.526075 19336 raft_consensus.cc:2781] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:49.526280 19336 raft_consensus.cc:686] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 1 LEADER]: Becoming Leader. State: Replica: cd6830bca6bd41b3960591b4ef186223, State: Running, Role: LEADER
I20260807 18:43:49.526436 19336 consensus_queue.cc:237] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } }
I20260807 18:43:49.528133 18788 catalog_manager.cc:5495] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6830bca6bd41b3960591b4ef186223 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "cd6830bca6bd41b3960591b4ef186223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd6830bca6bd41b3960591b4ef186223" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 } health_report { overall_health: UNKNOWN } } }
I20260807 18:43:49.558712 19410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.555762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42286 (local address 127.10.174.193:36963)
0807 18:43:49.555981 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:49.555984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:49.556015 (+ 31us) server_negotiation.cc:407] Connection header received
0807 18:43:49.556056 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:49.556057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:49.556096 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:49.556165 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:49.556378 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.556879 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.557704 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.557923 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.558000 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:49.558260 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:49.558344 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:49.558402 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:49.558485 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 18:43:49.558525 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
I20260807 18:43:49.568176 19414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.565144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:58713 (local address 127.10.174.195:43857)
0807 18:43:49.565384 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:49.565388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:49.565431 (+ 43us) server_negotiation.cc:407] Connection header received
0807 18:43:49.565589 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:49.565591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:49.565633 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:49.565703 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:49.565925 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.566466 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.567257 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.567516 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.567594 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:49.567833 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:49.567895 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:49.567948 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:49.568025 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 18:43:49.568065 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":109,"threads_started":1}
I20260807 18:43:49.568195 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.565076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:43857 (local address 127.10.174.193:58713)
0807 18:43:49.565374 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:49.565387 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:49.565471 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:49.565728 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:49.565730 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:49.565736 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:49.565830 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:49.565834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.566556 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.566558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:49.567144 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:49.567151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.567613 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.567615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:49.567683 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:49.567722 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:49.567966 (+ 244us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:49.567971 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 18:43:49.568018 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 18:43:49.568074 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
I20260807 18:43:49.573711 19099 raft_consensus.cc:1261] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Refusing update from remote peer cd6830bca6bd41b3960591b4ef186223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:49.573832 19242 raft_consensus.cc:1261] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Refusing update from remote peer cd6830bca6bd41b3960591b4ef186223: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:43:49.574163 19406 consensus_queue.cc:1035] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dec69e0114549a49d557ae1df9d5288" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:49.574734 19406 consensus_queue.cc:1035] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b980563f0fd2477c9bc34b9f6c46e4e5" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 43857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:43:49.594203 19410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.590721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:35387 (local address 127.10.174.193:36963)
0807 18:43:49.590844 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:49.590850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:49.591014 (+ 164us) server_negotiation.cc:407] Connection header received
0807 18:43:49.591151 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:49.591154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:49.591203 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:49.591280 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:43:49.591547 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.592091 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.593071 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.593426 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.593538 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:49.593785 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:43:49.593857 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:43:49.593933 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:49.594016 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 18:43:49.594081 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 18:43:49.594242 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.590665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36963 (local address 127.10.174.195:35387)
0807 18:43:49.590926 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:49.590944 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:49.591054 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:49.591311 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:49.591314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:49.591321 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 18:43:49.591441 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:49.591446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.592214 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.592217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:49.592950 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:49.592960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:49.593548 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:49.593551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:49.593634 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:49.593667 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 18:43:49.593938 (+ 271us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 18:43:49.593947 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 18:43:49.594008 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 18:43:49.594100 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
I20260807 18:43:49.612588 18788 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:49.612741 18788 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:43:49.614627 18788 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fd8c516acd341eaad2b744fcf79913e: Sending DeleteTablet for 3 replicas of tablet b6edbdb2ca0346baaf1e9c3f8606b54b
I20260807 18:43:49.615171 18932 tablet_service.cc:1514] Processing DeleteTablet for tablet b6edbdb2ca0346baaf1e9c3f8606b54b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:49 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 18:43:49.615250 19221 tablet_service.cc:1514] Processing DeleteTablet for tablet b6edbdb2ca0346baaf1e9c3f8606b54b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:49 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:48288
I20260807 18:43:49.615278 19077 tablet_service.cc:1514] Processing DeleteTablet for tablet b6edbdb2ca0346baaf1e9c3f8606b54b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:43:49 UTC) from {username='oryx', principal='oryx/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:40036
I20260807 18:43:49.615361 19343 tablet_replica.cc:330] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: stopping tablet replica
I20260807 18:43:49.615471 19341 tablet_replica.cc:330] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: stopping tablet replica
I20260807 18:43:49.615489 19343 raft_consensus.cc:2229] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:43:49.615598 19341 raft_consensus.cc:2229] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:49.615690 19343 raft_consensus.cc:2258] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:49.615710 19341 raft_consensus.cc:2258] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:49.615862 19342 tablet_replica.cc:330] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: stopping tablet replica
I20260807 18:43:49.615968 19342 raft_consensus.cc:2229] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:43:49.616091 19342 raft_consensus.cc:2258] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:43:49.616221 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 18865
I20260807 18:43:49.616452 19343 ts_tablet_manager.cc:1905] T b6edbdb2ca0346baaf1e9c3f8606b54b P cd6830bca6bd41b3960591b4ef186223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:49.616539 19341 ts_tablet_manager.cc:1905] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:49.617544 19342 ts_tablet_manager.cc:1905] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:43:49.619489 19342 ts_tablet_manager.cc:1918] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:49.619571 19342 log.cc:1196] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/b6edbdb2ca0346baaf1e9c3f8606b54b
I20260807 18:43:49.619732 19341 ts_tablet_manager.cc:1918] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 18:43:49.619810 19341 log.cc:1196] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/b6edbdb2ca0346baaf1e9c3f8606b54b
I20260807 18:43:49.619875 19342 ts_tablet_manager.cc:1939] T b6edbdb2ca0346baaf1e9c3f8606b54b P b980563f0fd2477c9bc34b9f6c46e4e5: Deleting consensus metadata
I20260807 18:43:49.620060 19341 ts_tablet_manager.cc:1939] T b6edbdb2ca0346baaf1e9c3f8606b54b P 9dec69e0114549a49d557ae1df9d5288: Deleting consensus metadata
I20260807 18:43:49.620733 18776 catalog_manager.cc:4841] TS b980563f0fd2477c9bc34b9f6c46e4e5 (127.10.174.195:43857): tablet b6edbdb2ca0346baaf1e9c3f8606b54b (table test-table [id=a0e37206ae4349c8adb32cafeb45644c]) successfully deleted
I20260807 18:43:49.620808 18773 catalog_manager.cc:4841] TS 9dec69e0114549a49d557ae1df9d5288 (127.10.174.194:36321): tablet b6edbdb2ca0346baaf1e9c3f8606b54b (table test-table [id=a0e37206ae4349c8adb32cafeb45644c]) successfully deleted
W20260807 18:43:49.626974 18773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:36963 (error 108)
I20260807 18:43:49.627187 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19010
I20260807 18:43:49.629238 19421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:49.628770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36963 (local address 127.0.0.1:42292)
0807 18:43:49.629024 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:49.629113 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":69,"threads_started":1}
W20260807 18:43:49.629498 18773 catalog_manager.cc:4584] TS cd6830bca6bd41b3960591b4ef186223 (127.10.174.193:36963): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b6edbdb2ca0346baaf1e9c3f8606b54b: Network error: Client connection negotiation failed: client connection to 127.10.174.193:36963: connect: Connection refused (error 111)
I20260807 18:43:49.635116 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19154
I20260807 18:43:49.642264 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 18756
2026-08-07T18:43:49Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3499 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:49 dist-test-slave-07c2 krb5kdc[19424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:49 dist-test-slave-07c2 krb5kdc[19424](info): set up 2 sockets
Aug 07 18:43:49 dist-test-slave-07c2 krb5kdc[19424](info): commencing operation
krb5kdc: starting...
W20260807 18:43:50.690104 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:50 dist-test-slave-07c2 krb5kdc[19424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:50.817673 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39025
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:39025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:50.920655 19437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:50.920915 19437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:50.920986 19437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:50.924862 19437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:50.924942 19437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:50.924979 19437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:50.925029 19437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:50.925062 19437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:50.930097 19437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:39025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:50.931039 19437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:50.931990 19437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:50.940068 19442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:50.940166 19437 server_base.cc:1034] running on GCE node
W20260807 18:43:50.940069 19443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:50.940068 19445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:50.940865 19437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:50.941834 19437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:50.943017 19437 hybrid_clock.cc:648] HybridClock initialized: now 1786128230942991 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T18:43:50Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1310 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:43:51 dist-test-slave-07c2 krb5kdc[19450](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:43:51 dist-test-slave-07c2 krb5kdc[19450](info): set up 2 sockets
Aug 07 18:43:51 dist-test-slave-07c2 krb5kdc[19450](info): commencing operation
krb5kdc: starting...
W20260807 18:43:52.003435 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:43:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:43:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:43:52.124204 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45657
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:45657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:52.231832 19463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:52.232059 19463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:52.232097 19463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:52.236090 19463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:52.236140 19463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:52.236161 19463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:52.236177 19463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:52.236227 19463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:52.241331 19463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:45657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:52.242277 19463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:52.243222 19463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:52.251044 19468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:52.251080 19469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:52.251106 19471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:52.251451 19463 server_base.cc:1034] running on GCE node
I20260807 18:43:52.251994 19463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:52.252969 19463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:52.254173 19463 hybrid_clock.cc:648] HybridClock initialized: now 1786128232254153 us; error 30 us; skew 500 ppm
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:52.257103 19463 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:52.257925 19463 webserver.cc:460] Webserver started at http://127.10.174.254:39025/ using document root <none> and password file <none>
I20260807 18:43:52.258435 19463 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:52.258492 19463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:52.258652 19463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:52.260694 19463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "26c87b23f5bb4efbb73258af9a548074"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "d9e21e294b75148bb72579324cb402e6"
server_key_iv: "d47699e9d464529c1cc10c2e107469ed"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.261237 19463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "26c87b23f5bb4efbb73258af9a548074"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "d9e21e294b75148bb72579324cb402e6"
server_key_iv: "d47699e9d464529c1cc10c2e107469ed"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.264819 19463 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 18:43:52.267105 19478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.268388 19463 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:43:52.268563 19463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "26c87b23f5bb4efbb73258af9a548074"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "d9e21e294b75148bb72579324cb402e6"
server_key_iv: "d47699e9d464529c1cc10c2e107469ed"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.268694 19463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:52.292621 19463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:52.295550 19463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:52.295769 19463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:52.302954 19463 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:45657
I20260807 18:43:52.302966 19531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:45657 every 8 connection(s)
I20260807 18:43:52.303949 19463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:52.306617 19532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:43:52.310361 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19463
I20260807 18:43:52.310505 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:43:52.310811 10939 external_mini_cluster.cc:1428] Setting key f3c83403615f3ea19d0f5318669e28cc
I20260807 18:43:52.312222 19532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Bootstrap starting.
I20260807 18:43:52.314476 19532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Neither blocks nor log segments found. Creating new log.
I20260807 18:43:52.315275 19532 log.cc:824] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:52.317378 19532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: No bootstrap required, opened a new log
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:52.321667 19532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:52.321943 19532 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:43:52.322027 19532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c87b23f5bb4efbb73258af9a548074, State: Initialized, Role: FOLLOWER
I20260807 18:43:52.322502 19532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:52.322646 19532 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:52.322714 19532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:52.322813 19532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:43:52.323937 19532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:52.324311 19532 leader_election.cc:302] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26c87b23f5bb4efbb73258af9a548074; no voters:
I20260807 18:43:52.324654 19532 leader_election.cc:288] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:43:52.324749 19537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:43:52.325038 19537 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 LEADER]: Becoming Leader. State: Replica: 26c87b23f5bb4efbb73258af9a548074, State: Running, Role: LEADER
I20260807 18:43:52.325388 19537 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:52.325939 19532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:52.326035 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:52.312193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60754 (local address 127.10.174.254:45657)
0807 18:43:52.312643 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:52.312659 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:52.312695 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:43:52.313358 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:52.313373 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:52.313692 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:52.313973 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:52.314922 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.316110 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.317255 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.317798 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.317924 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:52.320720 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:52.320725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:52.320738 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:52.320765 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:52.322666 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:52.323220 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:52.323224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:52.323229 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:52.323407 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:52.323695 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:52.323698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:52.323699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:52.324102 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:52.324281 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:52.324720 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 18:43:52.325041 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":167,"threads_started":1}
I20260807 18:43:52.327148 19538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26c87b23f5bb4efbb73258af9a548074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } } }
I20260807 18:43:52.327167 19539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26c87b23f5bb4efbb73258af9a548074. Latest consensus state: current_term: 1 leader_uuid: "26c87b23f5bb4efbb73258af9a548074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } } }
I20260807 18:43:52.327346 19538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:52.327354 19539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: This master's current role is: LEADER
W20260807 18:43:52.330950 19552 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:43:52.331030 19552 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:43:52.331106 19546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:52.331864 19546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:52.337270 19546 catalog_manager.cc:1347] Generated new cluster ID: 2e6696e04b5744199dab7b3480e7ad6f
I20260807 18:43:52.337332 19546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:52.347828 19546 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:43:52.348686 19546 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:52.360860 19546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Generated new TSK 0
I20260807 18:43:52.361569 19546 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:43:52.393810 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:45657
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:52.531718 19558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:52.531958 19558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:52.531998 19558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:52.535904 19558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:52.535962 19558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:52.536036 19558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:52.541446 19558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:52.542440 19558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:52.543500 19558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:52.553071 19563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:52.553203 19558 server_base.cc:1034] running on GCE node
W20260807 18:43:52.553048 19566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:52.553121 19564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:52.553769 19558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:52.554332 19558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:52.555487 19558 hybrid_clock.cc:648] HybridClock initialized: now 1786128232555468 us; error 30 us; skew 500 ppm
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:52.561542 19558 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:43:52.562510 19558 webserver.cc:460] Webserver started at http://127.10.174.193:35299/ using document root <none> and password file <none>
I20260807 18:43:52.563087 19558 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:52.563184 19558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:52.563477 19558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:52.565554 19558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "2edbb4fda7da4871b1273214edb495ea"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "855f53fada247276db3c2e863eb0462a"
server_key_iv: "0eb3979ce3ffe0ccb28cd089aa549e6f"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.566146 19558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "2edbb4fda7da4871b1273214edb495ea"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "855f53fada247276db3c2e863eb0462a"
server_key_iv: "0eb3979ce3ffe0ccb28cd089aa549e6f"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.569954 19558 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:43:52.572510 19575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.573769 19558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:43:52.573899 19558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "2edbb4fda7da4871b1273214edb495ea"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "855f53fada247276db3c2e863eb0462a"
server_key_iv: "0eb3979ce3ffe0ccb28cd089aa549e6f"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.574011 19558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:52.590617 19558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:52.593544 19558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:52.593751 19558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:52.594372 19558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:52.595202 19558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:52.595311 19558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.595409 19558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:52.595463 19558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.604565 19558 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:39729
I20260807 18:43:52.604592 19689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:39729 every 8 connection(s)
I20260807 18:43:52.605445 19558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:52.611588 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19558
I20260807 18:43:52.611734 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:43:52.612085 10939 external_mini_cluster.cc:1428] Setting key af7579d0f00e585cf11604ac149a6c00
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:52.619926 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:52.607126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:34405 (local address 127.10.174.254:45657)
0807 18:43:52.607267 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:52.607270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:52.608393 (+ 1123us) server_negotiation.cc:407] Connection header received
0807 18:43:52.609525 (+ 1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:52.609528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:52.609577 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:52.609657 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:52.610738 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.611621 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.613502 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.613826 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.613951 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:52.616421 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:52.616424 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:52.616427 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:52.616456 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:52.617818 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:52.618332 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:52.618337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:52.618339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:52.618421 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:52.618771 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:52.618774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:52.618776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:52.618955 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:52.619060 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:52.619629 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 18:43:52.619756 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:43:52.620687 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:52.607514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:34405)
0807 18:43:52.608198 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:52.608270 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:52.609225 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:52.609812 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:52.609818 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:52.610147 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:52.610606 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:52.610618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.611781 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.611784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:52.613153 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:52.613177 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.614008 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.614013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:52.614186 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:52.614781 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:52.614797 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:52.616257 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:52.617941 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:52.617946 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:52.617961 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:52.618223 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:52.618517 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:52.618521 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:52.618523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:52.618669 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:52.619074 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:52.619082 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:52.619388 (+ 306us) client_negotiation.cc:769] Sending connection context
0807 18:43:52.619574 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 18:43:52.619890 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:43:52.621944 19690 heartbeater.cc:347] Connected to a master server at 127.10.174.254:45657
I20260807 18:43:52.622205 19690 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:52.622676 19690 heartbeater.cc:511] Master 127.10.174.254:45657 requested a full tablet report, sending...
I20260807 18:43:52.624257 19495 ts_manager.cc:194] Registered new tserver with Master: 2edbb4fda7da4871b1273214edb495ea (127.10.174.193:39729)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:43:52.625403 19495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:34405
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:43:52.638226 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:45657
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:52.745432 19695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:52.745666 19695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:52.745707 19695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:52.749852 19695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:52.749907 19695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:52.750005 19695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:52.755051 19695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:52.756019 19695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:52.756976 19695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:52.766415 19701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:52.766407 19700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:52.766455 19703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:52.766592 19695 server_base.cc:1034] running on GCE node
I20260807 18:43:52.767143 19695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:52.767740 19695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:52.768908 19695 hybrid_clock.cc:648] HybridClock initialized: now 1786128232768894 us; error 24 us; skew 500 ppm
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:52.771639 19695 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:43:52.772447 19695 webserver.cc:460] Webserver started at http://127.10.174.194:42155/ using document root <none> and password file <none>
I20260807 18:43:52.773029 19695 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:52.773118 19695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:52.773343 19695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:52.775276 19695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "45f8add89bc34298ab5ca126d861fd8f"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "35160a140daeacc25f8cb0b9c2a59fd5"
server_key_iv: "8def5e42109a036094a38ef95caab06a"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.775969 19695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "45f8add89bc34298ab5ca126d861fd8f"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "35160a140daeacc25f8cb0b9c2a59fd5"
server_key_iv: "8def5e42109a036094a38ef95caab06a"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.779636 19695 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 18:43:52.781916 19710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.783025 19695 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:52.783154 19695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "45f8add89bc34298ab5ca126d861fd8f"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "35160a140daeacc25f8cb0b9c2a59fd5"
server_key_iv: "8def5e42109a036094a38ef95caab06a"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.783260 19695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:52.800534 19695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:52.803756 19695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:52.803951 19695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:52.804514 19695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:52.805302 19695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:52.805370 19695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.805439 19695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:52.805482 19695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.814205 19695 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44727
I20260807 18:43:52.814242 19827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44727 every 8 connection(s)
I20260807 18:43:52.815039 19695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:52.824095 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19695
I20260807 18:43:52.824218 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:43:52.824546 10939 external_mini_cluster.cc:1428] Setting key 1f3c203e278486e875a69a93e88fb5ff
I20260807 18:43:52.828709 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:52.816756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:34725 (local address 127.10.174.254:45657)
0807 18:43:52.816891 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:52.816894 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:52.817867 (+ 973us) server_negotiation.cc:407] Connection header received
0807 18:43:52.818754 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:52.818758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:52.818817 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:52.818926 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:52.820120 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.820645 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.821750 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.821965 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.822073 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:52.824540 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:52.824544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:52.824546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:52.824576 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:52.826291 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:52.826985 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:52.826989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:52.826991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:52.827077 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:52.827471 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:52.827476 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:52.827478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:52.827664 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:52.827784 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:52.828459 (+ 675us) server_negotiation.cc:299] Negotiation successful
0807 18:43:52.828591 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:43:52.829711 19830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:52.817078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:34725)
0807 18:43:52.817724 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:52.817766 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:52.818554 (+ 788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:52.819100 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:52.819107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:52.819521 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:52.819970 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:52.819983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.820776 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.820779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:52.821622 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:52.821631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:52.822109 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:52.822114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:52.822299 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:52.822824 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:52.822838 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:52.824381 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:52.826412 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:52.826417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:52.826431 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:52.826885 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:52.827169 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:52.827173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:52.827175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:52.827371 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:52.827868 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:52.827876 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:52.828136 (+ 260us) client_negotiation.cc:769] Sending connection context
0807 18:43:52.828362 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 18:43:52.828709 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":133,"threads_started":1}
I20260807 18:43:52.830830 19828 heartbeater.cc:347] Connected to a master server at 127.10.174.254:45657
I20260807 18:43:52.831096 19828 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:52.831615 19828 heartbeater.cc:511] Master 127.10.174.254:45657 requested a full tablet report, sending...
I20260807 18:43:52.832584 19495 ts_manager.cc:194] Registered new tserver with Master: 45f8add89bc34298ab5ca126d861fd8f (127.10.174.194:44727)
I20260807 18:43:52.833137 19495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:34725
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:43:52.851277 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:45657
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:52.957449 19833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:52.957707 19833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:52.957787 19833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:52.961660 19833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:52.961741 19833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:52.961833 19833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:52.966775 19833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:52.967715 19833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:52.968655 19833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:52.977641 19841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:52.977648 19838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:52.977738 19833 server_base.cc:1034] running on GCE node
W20260807 18:43:52.977651 19839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:52.978320 19833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:52.978973 19833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:52.980129 19833 hybrid_clock.cc:648] HybridClock initialized: now 1786128232980117 us; error 26 us; skew 500 ppm
Aug 07 18:43:52 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:52.982666 19833 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:43:52.983553 19833 webserver.cc:460] Webserver started at http://127.10.174.195:39475/ using document root <none> and password file <none>
I20260807 18:43:52.984068 19833 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:52.984156 19833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:52.984381 19833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:43:52.986433 19833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "cd0450076c334b2080db7a3292294160"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "4c6c6e06b4ca6126c2f7aa534d579057"
server_key_iv: "f9662160785284aaa8ff8d43773a9018"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.987044 19833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "cd0450076c334b2080db7a3292294160"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "4c6c6e06b4ca6126c2f7aa534d579057"
server_key_iv: "f9662160785284aaa8ff8d43773a9018"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.990649 19833 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:43:52.992940 19848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:52.994065 19833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 18:43:52.994195 19833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "cd0450076c334b2080db7a3292294160"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "4c6c6e06b4ca6126c2f7aa534d579057"
server_key_iv: "f9662160785284aaa8ff8d43773a9018"
server_key_version: "encryptionkey@0"
I20260807 18:43:52.994307 19833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:53.008637 19833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:53.011381 19833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:53.011574 19833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:53.012151 19833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:53.012939 19833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:53.013008 19833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.013079 19833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:53.013123 19833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.021548 19833 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:41139
I20260807 18:43:53.021576 19965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:41139 every 8 connection(s)
I20260807 18:43:53.022364 19833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:53.026901 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19833
I20260807 18:43:53.027036 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:43:53.027396 10939 external_mini_cluster.cc:1428] Setting key 6646442c9ee04b0ce8dd8079677dba7d
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128232, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:43:53.035199 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.024085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:47511 (local address 127.10.174.254:45657)
0807 18:43:53.024254 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.024260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.025185 (+ 925us) server_negotiation.cc:407] Connection header received
0807 18:43:53.025952 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.025954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.025999 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.026131 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.027477 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.028171 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.029596 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.029813 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.029895 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.032098 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:53.032101 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:53.032103 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:53.032126 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:53.033597 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:53.034012 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:53.034015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:53.034016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:53.034087 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:53.034363 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:53.034365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:53.034366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:53.034521 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:53.034594 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:53.034988 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 18:43:53.035074 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 18:43:53.035902 19968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.024441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:47511)
0807 18:43:53.025045 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.025082 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.025784 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.026288 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.026294 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.026603 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.027311 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.027333 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.028319 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.028323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.029481 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.029493 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.029933 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.029935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.030063 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.030536 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.030551 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.031955 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:43:53.033690 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:53.033694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:53.033703 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:53.033930 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:53.034163 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:43:53.034165 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:43:53.034166 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:43:53.034285 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:43:53.034603 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:43:53.034608 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:43:53.034803 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 18:43:53.034942 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 18:43:53.035148 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":110,"threads_started":1}
I20260807 18:43:53.036871 19966 heartbeater.cc:347] Connected to a master server at 127.10.174.254:45657
I20260807 18:43:53.037092 19966 heartbeater.cc:464] Registering TS with master...
I20260807 18:43:53.037528 19966 heartbeater.cc:511] Master 127.10.174.254:45657 requested a full tablet report, sending...
I20260807 18:43:53.038450 19495 ts_manager.cc:194] Registered new tserver with Master: cd0450076c334b2080db7a3292294160 (127.10.174.195:41139)
I20260807 18:43:53.038985 19495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:47511
I20260807 18:43:53.041004 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab.
Entry for principal oryx/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab.
WARNING: no policy specified for oryx/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab.
Entry for principal oryx/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab.
WARNING: no policy specified for oryx/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab.
Entry for principal oryx/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab.
I20260807 18:43:53.109938 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19558
I20260807 18:43:53.116596 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19695
I20260807 18:43:53.123529 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19833
I20260807 18:43:53.129565 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19463
I20260807 18:43:53.136083 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45657
--webserver_interface=127.10.174.254
--webserver_port=39025
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:45657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:43:53.245667 19975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:53.245949 19975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:53.245990 19975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:53.250015 19975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:43:53.250079 19975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:53.250099 19975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:53.250183 19975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:43:53.250222 19975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:43:53.255541 19975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:45657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=39025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:53.256595 19975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:53.257617 19975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:53.265731 19981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:53.265731 19984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:53.265759 19980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:53.265892 19975 server_base.cc:1034] running on GCE node
I20260807 18:43:53.266522 19975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:53.267673 19975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:53.268837 19975 hybrid_clock.cc:648] HybridClock initialized: now 1786128233268809 us; error 38 us; skew 500 ppm
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128233, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:53.271660 19975 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:43:53.272511 19975 webserver.cc:460] Webserver started at http://127.10.174.254:39025/ using document root <none> and password file <none>
I20260807 18:43:53.273068 19975 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:53.273185 19975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:53.277014 19975 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:43:53.279080 19991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.280345 19975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:53.280483 19975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "26c87b23f5bb4efbb73258af9a548074"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "d9e21e294b75148bb72579324cb402e6"
server_key_iv: "d47699e9d464529c1cc10c2e107469ed"
server_key_version: "encryptionkey@0"
I20260807 18:43:53.281034 19975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:53.290707 19975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:53.293568 19975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:53.293776 19975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:53.300768 19975 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:45657
I20260807 18:43:53.300839 20044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:45657 every 8 connection(s)
I20260807 18:43:53.301769 19975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:43:53.302145 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 19975
I20260807 18:43:53.302642 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:39729
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:45657
--webserver_port=35299
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:43:53.306985 20045 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:43:53.308615 20045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Bootstrap starting.
I20260807 18:43:53.324715 20045 log.cc:824] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Log is configured to *not* fsync() on all Append() calls
I20260807 18:43:53.330976 20045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:43:53.331404 20045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Bootstrap complete.
I20260807 18:43:53.335572 20045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:53.335989 20045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c87b23f5bb4efbb73258af9a548074, State: Initialized, Role: FOLLOWER
I20260807 18:43:53.336490 20045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:53.336632 20045 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:43:53.336725 20045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:43:53.336840 20045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:43:53.338701 20045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:53.339026 20045 leader_election.cc:302] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26c87b23f5bb4efbb73258af9a548074; no voters:
I20260807 18:43:53.339375 20045 leader_election.cc:288] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:43:53.339460 20049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:43:53.339643 20049 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [term 2 LEADER]: Becoming Leader. State: Replica: 26c87b23f5bb4efbb73258af9a548074, State: Running, Role: LEADER
I20260807 18:43:53.339918 20049 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } }
I20260807 18:43:53.340546 20045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:43:53.340834 20051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26c87b23f5bb4efbb73258af9a548074. Latest consensus state: current_term: 2 leader_uuid: "26c87b23f5bb4efbb73258af9a548074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } } }
I20260807 18:43:53.340953 20051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:53.341305 20050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "26c87b23f5bb4efbb73258af9a548074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26c87b23f5bb4efbb73258af9a548074" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45657 } } }
I20260807 18:43:53.341421 20050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074 [sys.catalog]: This master's current role is: LEADER
I20260807 18:43:53.341707 20053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:43:53.344861 20053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:43:53.345530 20053 catalog_manager.cc:1259] Loaded cluster ID: 2e6696e04b5744199dab7b3480e7ad6f
I20260807 18:43:53.345607 20053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:43:53.347208 20053 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:43:53.347844 20053 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 26c87b23f5bb4efbb73258af9a548074: Loaded TSK: 0
I20260807 18:43:53.348762 20053 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 18:43:53.424185 20047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:53.424485 20047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:53.424563 20047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:53.428614 20047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:53.428697 20047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:53.428789 20047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:43:53.434077 20047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.193.keytab
--principal=oryx/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:39729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=35299
--tserver_master_addrs=127.10.174.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:53.435163 20047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:53.436235 20047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:53.446740 20077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:53.446905 20047 server_base.cc:1034] running on GCE node
W20260807 18:43:53.446794 20075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:53.447144 20074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:53.447600 20047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:53.448238 20047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:53.449426 20047 hybrid_clock.cc:648] HybridClock initialized: now 1786128233449393 us; error 49 us; skew 500 ppm
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128233, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:53.452355 20047 init.cc:377] Logged in from keytab as oryx/127.10.174.193@KRBTEST.COM (short username oryx)
I20260807 18:43:53.453301 20047 webserver.cc:460] Webserver started at http://127.10.174.193:35299/ using document root <none> and password file <none>
I20260807 18:43:53.453860 20047 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:53.453965 20047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:53.457808 20047 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:43:53.459887 20084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.461122 20047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:53.461215 20047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "2edbb4fda7da4871b1273214edb495ea"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "855f53fada247276db3c2e863eb0462a"
server_key_iv: "0eb3979ce3ffe0ccb28cd089aa549e6f"
server_key_version: "encryptionkey@0"
I20260807 18:43:53.461805 20047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:53.486084 20047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:53.489466 20047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:53.489677 20047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:53.490382 20047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:53.491206 20047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:53.491253 20047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.491343 20047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:53.491380 20047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.500141 20047 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:39729
I20260807 18:43:53.500183 20201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:39729 every 8 connection(s)
I20260807 18:43:53.501138 20047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:43:53.510147 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20047
I20260807 18:43:53.510644 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:44727
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:45657
--webserver_port=42155
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.513274 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.503259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:43873)
0807 18:43:53.503940 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.503981 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.504703 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.505626 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.505632 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.505950 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.506383 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.506397 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.507712 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.507714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.508553 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.508562 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.509262 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.509265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.509392 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.509963 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.509987 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.512577 (+ 2590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":124,"threads_started":1}
W20260807 18:43:53.513731 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.503105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43873 (local address 127.10.174.254:45657)
0807 18:43:53.503579 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.503599 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.504103 (+ 504us) server_negotiation.cc:407] Connection header received
0807 18:43:53.505017 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.505027 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.505288 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.505542 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.506531 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.507587 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.508654 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.509123 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.509237 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.512869 (+ 3632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:43873: BlockingRecv error: recv got EOF from 127.10.174.193:43873 (error 108)
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":156,"threads_started":1}
W20260807 18:43:53.513921 20202 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:45657 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.174.254:45657: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.519266 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.514452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:35661)
0807 18:43:53.514569 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.514587 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.514671 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.514902 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.514905 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.515053 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.515141 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.515146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.515892 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.515897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.516426 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.516433 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.516879 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.516882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.516979 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.517447 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.517458 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.519134 (+ 1676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 18:43:53.519639 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.514547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:35661 (local address 127.10.174.254:45657)
0807 18:43:53.514673 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.514678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.514693 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:43:53.514754 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.514757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.514804 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.514887 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.515251 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.515781 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.516544 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.516764 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.516874 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.519257 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:35661: BlockingRecv error: recv got EOF from 127.10.174.193:35661 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.524549 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.519790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:37585)
0807 18:43:53.519891 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.519907 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.519981 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.520351 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.520354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.520498 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.520564 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.520568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.521252 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.521257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.521756 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.521764 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.522210 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.522213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.522299 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.522734 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.522746 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.524438 (+ 1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 18:43:53.524667 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.520046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:37585 (local address 127.10.174.254:45657)
0807 18:43:53.520174 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.520177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.520187 (+ 10us) server_negotiation.cc:407] Connection header received
0807 18:43:53.520214 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.520215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.520247 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.520334 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.520671 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.521137 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.521882 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.522088 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.522204 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.524549 (+ 2345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:37585: BlockingRecv error: recv got EOF from 127.10.174.193:37585 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 18:43:53.524721 20202 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 18:43:53.627004 20206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:53.627281 20206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:53.627379 20206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:53.631279 20206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:53.631408 20206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:53.631501 20206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:43:53.636729 20206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.194.keytab
--principal=oryx/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:44727
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=42155
--tserver_master_addrs=127.10.174.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:53.637830 20206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:53.638851 20206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:53.648525 20211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:53.648579 20212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:53.648662 20206 server_base.cc:1034] running on GCE node
W20260807 18:43:53.648603 20214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:53.649156 20206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:53.649801 20206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:53.650985 20206 hybrid_clock.cc:648] HybridClock initialized: now 1786128233650965 us; error 31 us; skew 500 ppm
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128233, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:53.653769 20206 init.cc:377] Logged in from keytab as oryx/127.10.174.194@KRBTEST.COM (short username oryx)
I20260807 18:43:53.654652 20206 webserver.cc:460] Webserver started at http://127.10.174.194:42155/ using document root <none> and password file <none>
I20260807 18:43:53.655196 20206 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:53.655331 20206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:53.659015 20206 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 18:43:53.661046 20221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.662214 20206 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 18:43:53.662352 20206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "45f8add89bc34298ab5ca126d861fd8f"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "35160a140daeacc25f8cb0b9c2a59fd5"
server_key_iv: "8def5e42109a036094a38ef95caab06a"
server_key_version: "encryptionkey@0"
I20260807 18:43:53.662889 20206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:53.671952 20206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:53.674611 20206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:53.674814 20206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:53.675420 20206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:53.676204 20206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:53.676276 20206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.676347 20206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:53.676389 20206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.685491 20206 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44727
I20260807 18:43:53.685521 20338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44727 every 8 connection(s)
I20260807 18:43:53.686483 20206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:43:53.693787 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20206
I20260807 18:43:53.694236 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:41139
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:45657
--webserver_port=39475
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 18:43:53.697606 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.688308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:35719 (local address 127.10.174.254:45657)
0807 18:43:53.688449 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.688453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.689475 (+ 1022us) server_negotiation.cc:407] Connection header received
0807 18:43:53.690428 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.690432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.690494 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.690594 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.691791 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.692330 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.693463 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.693698 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.693802 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.697407 (+ 3605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:35719: BlockingRecv error: recv got EOF from 127.10.174.194:35719 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:43:53.698217 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.688711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:35719)
0807 18:43:53.689332 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.689370 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.690221 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.690773 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.690780 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.691121 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.691643 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.691657 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.692460 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.692468 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.693332 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.693341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.693840 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.693845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.694027 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.694671 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.694693 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.697212 (+ 2519us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":112,"threads_started":1}
W20260807 18:43:53.698793 20339 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:45657 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.174.254:45657: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.704480 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.699271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:49787)
0807 18:43:53.699419 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.699433 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.699539 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.699793 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.699796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.699960 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.700048 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.700053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.700767 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.700771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.701308 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.701316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.701767 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.701770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.701861 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.702401 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.702412 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.704345 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 18:43:53.704582 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.699416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:49787 (local address 127.10.174.254:45657)
0807 18:43:53.699551 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.699555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.699583 (+ 28us) server_negotiation.cc:407] Connection header received
0807 18:43:53.699626 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.699630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.699690 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.699776 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.700161 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.700658 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.701431 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.701655 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.701765 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.704461 (+ 2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:49787: BlockingRecv error: recv got EOF from 127.10.174.194:49787 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.710034 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.705106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:44199)
0807 18:43:53.705228 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.705244 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.705337 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.705565 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.705568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.705722 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.705787 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.705792 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.706477 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.706482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.707119 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.707130 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.707726 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.707729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.707786 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.708234 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.708245 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.709950 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 18:43:53.710206 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.705235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:44199 (local address 127.10.174.254:45657)
0807 18:43:53.705359 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.705365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.705381 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:53.705418 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.705421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.705462 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.705544 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.705896 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.706370 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.707251 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.707621 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.707726 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.710090 (+ 2364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:44199: BlockingRecv error: recv got EOF from 127.10.174.194:44199 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 18:43:53.710477 20339 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 18:43:53.805507 20342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:43:53.805761 20342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:43:53.805804 20342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:43:53.809850 20342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:43:53.809907 20342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:43:53.809964 20342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:43:53.815024 20342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/krb5kdc/oryx_127.10.174.195.keytab
--principal=oryx/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:41139
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=39475
--tserver_master_addrs=127.10.174.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:43:53.816042 20342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:43:53.817040 20342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:43:53.826083 20350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:53.826128 20347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:43:53.826098 20348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:43:53.826256 20342 server_base.cc:1034] running on GCE node
I20260807 18:43:53.826726 20342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:43:53.827370 20342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:43:53.828557 20342 hybrid_clock.cc:648] HybridClock initialized: now 1786128233828530 us; error 42 us; skew 500 ppm
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128233, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:43:53.831094 20342 init.cc:377] Logged in from keytab as oryx/127.10.174.195@KRBTEST.COM (short username oryx)
I20260807 18:43:53.831940 20342 webserver.cc:460] Webserver started at http://127.10.174.195:39475/ using document root <none> and password file <none>
I20260807 18:43:53.832474 20342 fs_manager.cc:359] Metadata directory not provided
I20260807 18:43:53.832578 20342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:43:53.836161 20342 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 18:43:53.838076 20357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.839162 20342 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:43:53.839350 20342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "cd0450076c334b2080db7a3292294160"
format_stamp: "Formatted at 2026-08-07 18:43:52 on dist-test-slave-07c2"
server_key: "4c6c6e06b4ca6126c2f7aa534d579057"
server_key_iv: "f9662160785284aaa8ff8d43773a9018"
server_key_version: "encryptionkey@0"
I20260807 18:43:53.839879 20342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:43:53.861873 20342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:43:53.865099 20342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:43:53.865306 20342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:43:53.865962 20342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:43:53.866894 20342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:43:53.866959 20342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.867023 20342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:43:53.867074 20342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:43:53.875808 20342 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:41139
I20260807 18:43:53.875844 20474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:41139 every 8 connection(s)
I20260807 18:43:53.876750 20342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:43:53.881700 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20342
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 18:43:53.888388 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.878568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:42225 (local address 127.10.174.254:45657)
0807 18:43:53.878706 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.878710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.879791 (+ 1081us) server_negotiation.cc:407] Connection header received
0807 18:43:53.880726 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.880730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.880787 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.880876 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.882115 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.882857 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.884428 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.884777 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.884890 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.888270 (+ 3380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:42225: BlockingRecv error: recv got EOF from 127.10.174.195:42225 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:43:53.889034 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.878910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:42225)
0807 18:43:53.879641 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.879682 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.880477 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.881066 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.881073 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.881424 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.881961 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.881976 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.882989 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.882993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.884325 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.884334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.884956 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.884960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.885150 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.885717 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.885736 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.888154 (+ 2418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":126,"threads_started":1}
W20260807 18:43:53.889436 20475 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:45657 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.174.254:45657: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
I20260807 18:43:53.892026 20479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.882708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60760 (local address 127.10.174.254:45657)
0807 18:43:53.882980 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.882984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.882997 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:43:53.883030 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.883032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.883067 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.883132 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.884096 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.884821 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.885928 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.886160 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.886234 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.887756 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:43:53.887761 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:43:53.887773 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:43:53.887798 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:43:53.889800 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:53.890385 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:53.890391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:53.890397 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:53.890550 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:43:53.890847 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:43:53.890850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:43:53.890851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:43:53.891235 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:43:53.891461 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 18:43:53.891675 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 18:43:53.891888 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":101,"threads_started":1}
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.895689 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.889857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:51427)
0807 18:43:53.890422 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.890437 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.890516 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.890798 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.890802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.890941 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.891031 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.891035 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.891916 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.891918 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.892628 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.892637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.893122 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.893125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.893191 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.893639 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.893650 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.895558 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496}
W20260807 18:43:53.895750 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.889925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:51427 (local address 127.10.174.254:45657)
0807 18:43:53.890082 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.890087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.890500 (+ 413us) server_negotiation.cc:407] Connection header received
0807 18:43:53.890584 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.890587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.890671 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.890746 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.891136 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.891824 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.892753 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.892998 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.893109 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.895653 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:51427: BlockingRecv error: recv got EOF from 127.10.174.195:51427 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:53 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:53.900209 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:53.896150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:44447)
0807 18:43:53.896270 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:53.896285 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:53.896352 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:53.896522 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:53.896524 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:53.896636 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:53.896696 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.896700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.897310 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.897312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.897777 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:53.897783 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.898170 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.898172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:53.898224 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.898655 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:53.898666 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:53.900128 (+ 1462us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 18:43:53.900337 20204 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:53.896226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:44447 (local address 127.10.174.254:45657)
0807 18:43:53.896368 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:53.896371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:53.896381 (+ 10us) server_negotiation.cc:407] Connection header received
0807 18:43:53.896407 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:53.896409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:53.896437 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:53.896498 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:53.896792 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.897229 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.897879 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:53.898080 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:53.898155 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:53.900237 (+ 2082us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:44447: BlockingRecv error: recv got EOF from 127.10.174.195:44447 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 18:43:53.900506 20475 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 18:43:54 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:54 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:54.530956 20480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:54.525404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:41207)
0807 18:43:54.525748 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:54.525764 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:54.525863 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:54.526209 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:54.526214 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:54.526407 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:54.526496 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:54.526502 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.527259 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.527264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:54.527864 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:54.527873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.528345 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.528348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:54.528435 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:54.528936 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:54.528948 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:54.530782 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":74,"threads_started":1}
W20260807 18:43:54.531030 20481 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:54.525496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:41207 (local address 127.10.174.254:45657)
0807 18:43:54.525793 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:54.525796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:54.525812 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:43:54.525974 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:54.525978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:54.526031 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:54.526129 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:54.526612 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.527149 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.527989 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.528229 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.528340 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:54.530902 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:41207: BlockingRecv error: recv got EOF from 127.10.174.193:41207 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":106,"threads_started":1}
Aug 07 18:43:54 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:54 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:54.716378 20482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:54.711014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:52689)
0807 18:43:54.711357 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:54.711371 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:54.711503 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:54.711776 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:54.711779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:54.711975 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:54.712084 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:54.712091 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.712868 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.712872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:54.713460 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:54.713469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.713934 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.713937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:54.714035 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:54.714502 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:54.714514 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:54.716273 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":79,"threads_started":1}
W20260807 18:43:54.716548 20481 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:54.711122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:52689 (local address 127.10.174.254:45657)
0807 18:43:54.711280 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:54.711312 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:54.711443 (+ 131us) server_negotiation.cc:407] Connection header received
0807 18:43:54.711603 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:54.711607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:54.711664 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:54.711750 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:54.712215 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.712754 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.713600 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.713821 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.713928 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:54.716396 (+ 2468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:52689: BlockingRecv error: recv got EOF from 127.10.174.194:52689 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 18:43:54 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:54 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:54.906759 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:54.901189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:48887)
0807 18:43:54.901459 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:54.901472 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:54.901590 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:54.901828 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:54.901830 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:54.902003 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:54.902140 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:54.902146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.902893 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.902896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:54.903615 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:54.903625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.904244 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.904248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:54.904356 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:54.904854 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:54.904866 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:54.906651 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":84,"threads_started":1}
W20260807 18:43:54.907015 20481 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:54.901256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:48887 (local address 127.10.174.254:45657)
0807 18:43:54.901391 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:54.901395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:54.901540 (+ 145us) server_negotiation.cc:407] Connection header received
0807 18:43:54.901668 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:54.901670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:54.901713 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:54.901790 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:54.902242 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.902768 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.903773 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:54.904114 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:54.904222 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:54.906790 (+ 2568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:48887: BlockingRecv error: recv got EOF from 127.10.174.195:48887 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 18:43:55 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:55 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:55.537225 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:55.531788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:38831)
0807 18:43:55.532076 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:55.532090 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:55.532179 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:55.532424 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:55.532426 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:55.532602 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:55.532698 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:55.532703 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.533403 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.533405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:55.533957 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:55.533964 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.534603 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.534607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:55.534676 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:55.535253 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:55.535272 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:55.537078 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":83,"threads_started":1}
W20260807 18:43:55.537335 20485 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:55.531903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:38831 (local address 127.10.174.254:45657)
0807 18:43:55.532142 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:55.532145 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:55.532159 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:43:55.532266 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:55.532268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:55.532312 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:55.532389 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:55.532792 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.533314 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.534101 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.534485 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.534591 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:55.537206 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:38831: BlockingRecv error: recv got EOF from 127.10.174.193:38831 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":61,"threads_started":1}
Aug 07 18:43:55 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:55 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:55.722477 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:55.717151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:45597)
0807 18:43:55.717446 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:55.717463 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:55.717602 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:55.717925 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:55.717928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:55.718125 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:55.718222 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:55.718228 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.718965 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.718968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:55.719546 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:55.719555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.720006 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.720009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:55.720070 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:55.720554 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:55.720565 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:55.722361 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":89,"threads_started":1}
W20260807 18:43:55.722604 20485 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:55.717207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:45597 (local address 127.10.174.254:45657)
0807 18:43:55.717358 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:55.717363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:55.717561 (+ 198us) server_negotiation.cc:407] Connection header received
0807 18:43:55.717710 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:55.717713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:55.717787 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:55.717878 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:55.718334 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.718847 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.719667 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.719909 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.719986 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:55.722487 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:45597: BlockingRecv error: recv got EOF from 127.10.174.194:45597 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 18:43:55 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:55 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:55.913549 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:55.907725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:50675)
0807 18:43:55.908050 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:55.908067 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:55.908196 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:55.908485 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:55.908487 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:55.908728 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:55.908830 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:55.908836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.909591 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.909598 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:55.910427 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:55.910446 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.910890 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.910894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:55.910980 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:55.911580 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:55.911594 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:55.913372 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":111,"threads_started":1}
W20260807 18:43:55.913609 20485 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:55.907917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:50675 (local address 127.10.174.254:45657)
0807 18:43:55.908058 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:55.908063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:55.908128 (+ 65us) server_negotiation.cc:407] Connection header received
0807 18:43:55.908325 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:55.908329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:55.908380 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:55.908462 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:55.908954 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.909483 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.910549 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:55.910778 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:55.910887 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:55.913502 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:50675: BlockingRecv error: recv got EOF from 127.10.174.195:50675 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 18:43:56 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:56 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:56.543493 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:56.538017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:60969)
0807 18:43:56.538288 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:56.538302 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:56.538390 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:56.538612 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:56.538614 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:56.538790 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:56.538886 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:56.538891 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.539658 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.539660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:56.540193 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:56.540200 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.540716 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.540719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:56.540781 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:56.541339 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:56.541350 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:56.543375 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":88,"threads_started":1}
W20260807 18:43:56.543632 20489 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:56.538105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:60969 (local address 127.10.174.254:45657)
0807 18:43:56.538386 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:56.538389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:56.538402 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:43:56.538459 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:56.538461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:56.538501 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:56.538577 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:56.539000 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.539566 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.540336 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.540605 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.540688 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:56.543478 (+ 2790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:60969: BlockingRecv error: recv got EOF from 127.10.174.193:60969 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":122,"threads_started":1}
Aug 07 18:43:56 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:56 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:56.728875 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:56.723332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:44225)
0807 18:43:56.723646 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:56.723660 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:56.723792 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:56.724064 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:56.724066 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:56.724273 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:56.724384 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:56.724390 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.725173 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.725177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:56.725747 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:56.725755 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.726214 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.726218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:56.726305 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:56.726800 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:56.726811 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:56.728693 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":123,"threads_started":1}
W20260807 18:43:56.728935 20489 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:56.723412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:44225 (local address 127.10.174.254:45657)
0807 18:43:56.723593 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:56.723598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:56.723735 (+ 137us) server_negotiation.cc:407] Connection header received
0807 18:43:56.723892 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:56.723895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:56.723947 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:56.724044 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:56.724504 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.725048 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.725867 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.726097 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.726206 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:56.728821 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:44225: BlockingRecv error: recv got EOF from 127.10.174.194:44225 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 18:43:56 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:56 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:56.920018 20491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:56.914373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:56599)
0807 18:43:56.914669 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:56.914682 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:56.914785 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:56.915032 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:56.915034 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:56.915230 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:56.915414 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:56.915426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.916357 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.916359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:56.917079 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:56.917089 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.917519 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.917522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:56.917581 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:56.918067 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:56.918078 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:56.919895 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":114,"threads_started":1}
W20260807 18:43:56.920189 20489 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:56.914489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:56599 (local address 127.10.174.254:45657)
0807 18:43:56.914624 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:56.914628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:56.914764 (+ 136us) server_negotiation.cc:407] Connection header received
0807 18:43:56.914867 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:56.914869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:56.914916 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:56.914994 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:56.915602 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.916230 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.917182 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:56.917422 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:56.917504 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:56.920032 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:56599: BlockingRecv error: recv got EOF from 127.10.174.195:56599 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 18:43:57 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:57 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:57.549511 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:57.544252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:57761)
0807 18:43:57.544532 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:57.544562 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:57.544687 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:57.544956 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:57.544958 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:57.545132 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:57.545227 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:57.545231 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.545945 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.545947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:57.546505 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:57.546512 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.546922 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.546925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:57.546983 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:57.547590 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:57.547601 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:57.549395 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":90,"threads_started":1}
W20260807 18:43:57.549736 20493 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:57.544318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:57761 (local address 127.10.174.254:45657)
0807 18:43:57.544623 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:57.544628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:57.544651 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:43:57.544784 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:57.544786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:57.544829 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:57.544919 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:57.545337 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.545856 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.546602 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.546829 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.546905 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:57.549535 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:57761: BlockingRecv error: recv got EOF from 127.10.174.193:57761 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
Aug 07 18:43:57 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:57 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:57.742306 20494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:57.729637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:56961)
0807 18:43:57.729918 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:57.729930 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:57.730062 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:57.730335 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:57.730338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:57.730538 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:57.730631 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:57.730637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.731431 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.731435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:57.731989 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:57.731997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.732458 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.732462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:57.732557 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:57.740216 (+ 7659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:57.740230 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:57.742178 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
W20260807 18:43:57.742561 20493 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:57.729697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:56961 (local address 127.10.174.254:45657)
0807 18:43:57.729864 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:57.729869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:57.729999 (+ 130us) server_negotiation.cc:407] Connection header received
0807 18:43:57.730161 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:57.730163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:57.730221 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:57.730308 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:57.730747 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.731275 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.732108 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.732343 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.732451 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:57.742323 (+ 9872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:56961: BlockingRecv error: recv got EOF from 127.10.174.194:56961 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 18:43:57 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:57 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:57.926126 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:57.920830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:50673)
0807 18:43:57.921115 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:57.921128 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:57.921225 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:57.921460 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:57.921462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:57.921640 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:57.921739 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:57.921744 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.922479 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.922482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:57.923048 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:57.923057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.923550 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.923553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:57.923622 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:57.924207 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:57.924220 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:57.926000 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
W20260807 18:43:57.926275 20493 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:57.920898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:50673 (local address 127.10.174.254:45657)
0807 18:43:57.921030 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:57.921033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:57.921192 (+ 159us) server_negotiation.cc:407] Connection header received
0807 18:43:57.921299 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:57.921302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:57.921352 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:57.921421 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:57.921846 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.922360 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.923165 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:57.923446 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:57.923521 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:57.926123 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:50673: BlockingRecv error: recv got EOF from 127.10.174.195:50673 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 18:43:58 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:58 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:58.555817 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:58.550405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:54165)
0807 18:43:58.550685 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:58.550699 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:58.550786 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:58.551056 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:58.551058 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:58.551261 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:58.551377 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:58.551383 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.552170 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.552173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:58.552728 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:58.552735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.553209 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.553211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:58.553282 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:58.553867 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:58.553882 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:58.555701 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":92,"threads_started":1}
W20260807 18:43:58.556056 20497 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:58.550458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:54165 (local address 127.10.174.254:45657)
0807 18:43:58.550720 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:58.550723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:58.550740 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:43:58.550910 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:58.550913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:58.550959 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:58.551040 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:58.551494 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.552043 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.552861 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.553101 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.553193 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:58.555885 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:54165: BlockingRecv error: recv got EOF from 127.10.174.193:54165 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":66,"threads_started":1}
Aug 07 18:43:58 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:58 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:58.748646 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:58.743109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:35727)
0807 18:43:58.743495 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:58.743511 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:58.743662 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:58.743946 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:58.743949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:58.744177 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:58.744268 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:58.744274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.745095 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.745100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:58.745682 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:58.745690 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.746142 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.746146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:58.746239 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:58.746725 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:58.746736 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:58.748523 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":135,"threads_started":1}
W20260807 18:43:58.748833 20497 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:58.743272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:35727 (local address 127.10.174.254:45657)
0807 18:43:58.743429 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:58.743435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:58.743615 (+ 180us) server_negotiation.cc:407] Connection header received
0807 18:43:58.743779 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:58.743782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:58.743833 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:58.743926 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:58.744387 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.744988 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.745806 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.746029 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.746136 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:58.748676 (+ 2540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:35727: BlockingRecv error: recv got EOF from 127.10.174.194:35727 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 18:43:58 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:58 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:58.932266 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:58.927062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:40495)
0807 18:43:58.927398 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:58.927411 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:58.927502 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:58.927736 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:58.927739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:58.927921 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:58.928013 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:58.928018 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.928750 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.928752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:58.929314 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:58.929321 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.929720 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.929723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:58.929781 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:58.930273 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:58.930285 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:58.932143 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
W20260807 18:43:58.932430 20497 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:58.927122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:40495 (local address 127.10.174.254:45657)
0807 18:43:58.927334 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:58.927342 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:58.927463 (+ 121us) server_negotiation.cc:407] Connection header received
0807 18:43:58.927582 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:58.927584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:58.927635 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:58.927698 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:58.928115 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.928654 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.929409 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:58.929628 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:58.929700 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:58.932276 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:40495: BlockingRecv error: recv got EOF from 127.10.174.195:40495 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 07 18:43:59 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:59 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:59.562203 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:59.556728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:58207)
0807 18:43:59.557002 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:59.557015 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:59.557163 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:59.557479 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:59.557482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:59.557750 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:59.557889 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:59.557897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.558638 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.558640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:59.559174 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:59.559181 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.559610 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.559613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:59.559675 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:59.560150 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:59.560166 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:59.562093 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":101,"threads_started":1}
W20260807 18:43:59.562368 20501 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:59.556756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:58207 (local address 127.10.174.254:45657)
0807 18:43:59.557027 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:59.557031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:59.557115 (+ 84us) server_negotiation.cc:407] Connection header received
0807 18:43:59.557282 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:59.557285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:59.557343 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:59.557444 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:59.558013 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.558547 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.559273 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.559514 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.559590 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:59.562234 (+ 2644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:58207: BlockingRecv error: recv got EOF from 127.10.174.193:58207 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
Aug 07 18:43:59 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:59 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:59.754910 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:59.749363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:34627)
0807 18:43:59.749707 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:59.749721 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:59.749868 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:59.750143 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:59.750147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:59.750357 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:59.750447 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:59.750453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.751374 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.751381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:59.752098 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:59.752108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.752538 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.752540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:59.752607 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:59.753086 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:59.753097 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:59.754799 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
W20260807 18:43:59.755051 20501 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:59.749487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:34627 (local address 127.10.174.254:45657)
0807 18:43:59.749655 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:59.749660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:59.749803 (+ 143us) server_negotiation.cc:407] Connection header received
0807 18:43:59.749977 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:59.749980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:59.750031 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:59.750115 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:59.750563 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.751186 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.752205 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.752427 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.752509 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:59.754935 (+ 2426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:34627: BlockingRecv error: recv got EOF from 127.10.174.194:34627 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 18:43:59 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:43:59 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:43:59.938254 20503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:43:59.933014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:52579)
0807 18:43:59.933276 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 18:43:59.933288 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:43:59.933382 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:43:59.933602 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:43:59.933604 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:43:59.933795 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:43:59.933888 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:59.933893 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.934612 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.934614 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:59.935152 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:43:59.935159 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.935662 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.935666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:43:59.935769 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:59.936299 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:43:59.936311 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:43:59.938138 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
W20260807 18:43:59.938392 20501 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:43:59.933093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:52579 (local address 127.10.174.254:45657)
0807 18:43:59.933239 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 18:43:59.933242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:43:59.933339 (+ 97us) server_negotiation.cc:407] Connection header received
0807 18:43:59.933449 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:43:59.933451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:43:59.933495 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:43:59.933561 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:43:59.933987 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.934507 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.935279 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:43:59.935534 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:43:59.935648 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:43:59.938271 (+ 2623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:52579: BlockingRecv error: recv got EOF from 127.10.174.195:52579 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 18:44:00 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:00 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:00.575042 20504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:00.563106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:42039)
0807 18:44:00.563492 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:00.563518 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:00.563616 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:00.563875 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:00.563877 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:00.564079 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:00.564177 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:00.564182 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.565010 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.565013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:00.565556 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:00.565563 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.566033 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.566036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:00.566097 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:00.573009 (+ 6912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:00.573022 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:00.574865 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":71,"threads_started":1}
W20260807 18:44:00.575137 20505 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:00.563345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:42039 (local address 127.10.174.254:45657)
0807 18:44:00.563594 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:00.563597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:00.563613 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:44:00.563711 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:00.563713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:00.563765 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:00.563835 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:00.564284 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.564910 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.565706 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.565934 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.566012 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:00.575001 (+ 8989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:42039: BlockingRecv error: recv got EOF from 127.10.174.193:42039 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":81,"threads_started":1}
Aug 07 18:44:00 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:00 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:00.761279 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:00.755794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:58085)
0807 18:44:00.756106 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:00.756119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:00.756222 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:00.756438 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:00.756440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:00.756625 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:00.756736 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:00.756742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.757460 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.757463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:00.758027 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:00.758036 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.758443 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.758446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:00.758509 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:00.758996 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:00.759007 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:00.761100 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":99,"threads_started":1}
W20260807 18:44:00.761317 20505 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:00.755871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58085 (local address 127.10.174.254:45657)
0807 18:44:00.756036 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:00.756042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:00.756192 (+ 150us) server_negotiation.cc:407] Connection header received
0807 18:44:00.756292 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:00.756294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:00.756338 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:00.756406 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:00.756836 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.757360 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.758130 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.758354 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.758430 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:00.761217 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:58085: BlockingRecv error: recv got EOF from 127.10.174.194:58085 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 18:44:00 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:00 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:00.944859 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:00.939137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:48707)
0807 18:44:00.939465 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:00.939479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:00.939580 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:00.939812 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:00.939814 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:00.940001 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:00.940112 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:00.940117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.940872 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.940875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:00.941546 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:00.941556 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.941982 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.941985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:00.942048 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:00.942637 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:00.942650 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:00.944686 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":79,"threads_started":1}
W20260807 18:44:00.944900 20505 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:00.939269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:48707 (local address 127.10.174.254:45657)
0807 18:44:00.939427 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:00.939431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:00.939557 (+ 126us) server_negotiation.cc:407] Connection header received
0807 18:44:00.939659 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:00.939662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:00.939707 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:00.939783 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:00.940230 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.940742 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.941655 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:00.941883 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:00.941958 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:00.944798 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:48707: BlockingRecv error: recv got EOF from 127.10.174.195:48707 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 18:44:01 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:01 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:01.582078 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:01.575803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:35971)
0807 18:44:01.576090 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:01.576108 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:01.576237 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:01.576778 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:01.576783 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:01.577053 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:01.577195 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:01.577203 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.578308 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.578312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:01.578932 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:01.578941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.579506 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.579509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:01.579582 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:01.580144 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:01.580156 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:01.581968 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":85,"threads_started":1}
W20260807 18:44:01.582218 20510 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:01.575933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:35971 (local address 127.10.174.254:45657)
0807 18:44:01.576517 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:01.576523 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:01.576540 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:44:01.576580 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:01.576583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:01.576630 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:01.576721 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:01.577352 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.578201 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.579039 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.579370 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.579476 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:01.582092 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:35971: BlockingRecv error: recv got EOF from 127.10.174.193:35971 (error 108)
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":93,"threads_started":1}
Aug 07 18:44:01 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:01 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:01.767892 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:01.762099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:58273)
0807 18:44:01.762439 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:01.762457 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:01.762600 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:01.762944 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:01.762947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:01.763149 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:01.763252 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:01.763258 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.764149 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.764152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:01.764778 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:01.764787 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.765198 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.765200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:01.765259 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:01.765827 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:01.765857 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:01.767780 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":118,"threads_started":1}
W20260807 18:44:01.768061 20510 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:01.762158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58273 (local address 127.10.174.254:45657)
0807 18:44:01.762327 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:01.762332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:01.762551 (+ 219us) server_negotiation.cc:407] Connection header received
0807 18:44:01.762713 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:01.762716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:01.762787 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:01.762893 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:01.763403 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.764059 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.764874 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.765092 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.765169 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:01.767909 (+ 2740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:58273: BlockingRecv error: recv got EOF from 127.10.174.194:58273 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 18:44:01 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:01 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:01.951050 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:01.945820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:52319)
0807 18:44:01.946251 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:01.946267 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:01.946389 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:01.946601 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:01.946602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:01.946786 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:01.946880 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:01.946884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.947600 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.947602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:01.948144 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:01.948152 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.948579 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.948581 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:01.948640 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:01.949209 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:01.949221 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:01.950939 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":92,"threads_started":1}
W20260807 18:44:01.951171 20510 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:01.945868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:52319 (local address 127.10.174.254:45657)
0807 18:44:01.946002 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:01.946008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:01.946358 (+ 350us) server_negotiation.cc:407] Connection header received
0807 18:44:01.946471 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:01.946473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:01.946522 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:01.946589 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:01.946973 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.947507 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.948262 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:01.948475 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:01.948561 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:01.951059 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:52319: BlockingRecv error: recv got EOF from 127.10.174.195:52319 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 18:44:02 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:02 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:02.588517 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:02.582887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:39919)
0807 18:44:02.583174 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:02.583186 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:02.583277 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:02.583548 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:02.583550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:02.583728 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:02.583832 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:02.583838 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.584638 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.584641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:02.585192 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:02.585199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.585704 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.585706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:02.585776 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:02.586270 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:02.586281 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:02.588326 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":110,"threads_started":1}
W20260807 18:44:02.588637 20514 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:02.582959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:39919 (local address 127.10.174.254:45657)
0807 18:44:02.583236 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:02.583240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:02.583254 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:44:02.583382 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:02.583384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:02.583428 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:02.583510 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:02.583938 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.584541 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.585353 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.585602 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.585686 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:02.588459 (+ 2773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:39919: BlockingRecv error: recv got EOF from 127.10.174.193:39919 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":120,"threads_started":1}
Aug 07 18:44:02 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:02 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:02.778494 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:02.768696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:37147)
0807 18:44:02.769011 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:02.769024 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:02.769125 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:02.769371 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:02.769374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:02.769562 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:02.769658 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:02.769663 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.770381 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.770383 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:02.770923 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:02.770930 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.771461 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.771467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:02.771554 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:02.776243 (+ 4689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:02.776259 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:02.778319 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":139,"threads_started":1}
W20260807 18:44:02.778591 20514 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:02.768775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:37147 (local address 127.10.174.254:45657)
0807 18:44:02.768931 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:02.768934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:02.769092 (+ 158us) server_negotiation.cc:407] Connection header received
0807 18:44:02.769212 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:02.769214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:02.769259 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:02.769331 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:02.769758 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.770285 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.771022 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.771253 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.771427 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:02.778470 (+ 7043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:37147: BlockingRecv error: recv got EOF from 127.10.174.194:37147 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 18:44:02 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:02 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:02.957388 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:02.951876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:58347)
0807 18:44:02.952147 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:02.952160 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:02.952268 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:02.952504 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:02.952506 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:02.952685 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:02.952780 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:02.952785 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.953506 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.953508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:02.954038 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:02.954044 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.954450 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.954453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:02.954510 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:02.955009 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:02.955020 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:02.957278 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":72,"threads_started":1}
W20260807 18:44:02.957528 20514 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:02.952017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:58347 (local address 127.10.174.254:45657)
0807 18:44:02.952184 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:02.952188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:02.952203 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:44:02.952354 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:02.952356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:02.952401 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:02.952467 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:02.952875 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.953416 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.954140 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:02.954358 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:02.954432 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:02.957409 (+ 2977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:58347: BlockingRecv error: recv got EOF from 127.10.174.195:58347 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 18:44:03 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:03 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:03.594543 20517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:03.589405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:52153)
0807 18:44:03.589670 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:03.589683 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:03.589782 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:03.590017 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:03.590019 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:03.590192 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:03.590287 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:03.590292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.591020 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.591022 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:03.591639 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:03.591648 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.592066 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.592069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:03.592129 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:03.592588 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:03.592599 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:03.594429 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":63,"threads_started":1}
W20260807 18:44:03.594698 20518 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:03.589452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:52153 (local address 127.10.174.254:45657)
0807 18:44:03.589694 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:03.589698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:03.589752 (+ 54us) server_negotiation.cc:407] Connection header received
0807 18:44:03.589864 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:03.589867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:03.589908 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:03.589983 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:03.590393 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.590926 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.591739 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.591968 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.592046 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:03.594566 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:52153: BlockingRecv error: recv got EOF from 127.10.174.193:52153 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":91,"threads_started":1}
Aug 07 18:44:03 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:03 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:03.785053 20519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:03.779424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:36651)
0807 18:44:03.779728 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:03.779743 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:03.779857 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:03.780166 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:03.780169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:03.780429 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:03.780557 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:03.780565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.781398 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.781400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:03.781953 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:03.781960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.782368 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.782370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:03.782430 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:03.782904 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:03.782915 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:03.784851 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":114,"threads_started":1}
W20260807 18:44:03.785073 20518 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:03.779454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:36651 (local address 127.10.174.254:45657)
0807 18:44:03.779632 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:03.779636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:03.779941 (+ 305us) server_negotiation.cc:407] Connection header received
0807 18:44:03.779980 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:03.779982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:03.780024 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:03.780116 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:03.780713 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.781294 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.782057 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.782272 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.782349 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:03.784973 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:36651: BlockingRecv error: recv got EOF from 127.10.174.194:36651 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 18:44:03 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:03 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:03.964001 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:03.958213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:51765)
0807 18:44:03.958525 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:03.958543 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:03.958678 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:03.958959 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:03.958962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:03.959169 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:03.959267 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:03.959272 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.960047 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.960052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:03.960649 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:03.960659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.961286 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.961290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:03.961381 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:03.961912 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:03.961924 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:03.963819 (+ 1895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":103,"threads_started":1}
W20260807 18:44:03.964051 20518 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:03.958375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:51765 (local address 127.10.174.254:45657)
0807 18:44:03.958525 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:03.958531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:03.958630 (+ 99us) server_negotiation.cc:407] Connection header received
0807 18:44:03.958791 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:03.958794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:03.958848 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:03.958937 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:03.959413 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.959937 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.960781 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:03.961153 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:03.961260 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:03.963940 (+ 2680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:51765: BlockingRecv error: recv got EOF from 127.10.174.195:51765 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 18:44:04 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:04 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:04.600998 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:04.595510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:47763)
0807 18:44:04.595813 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:04.595826 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:04.595915 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:04.596140 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:04.596142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:04.596328 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:04.596422 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:04.596427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.597164 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.597166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:04.597711 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:04.597718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.598138 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.598140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:04.598198 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:04.598664 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:04.598674 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:04.600830 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":105,"threads_started":1}
W20260807 18:44:04.601075 20522 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:04.595618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:47763 (local address 127.10.174.254:45657)
0807 18:44:04.595869 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:04.595873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:04.595885 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:44:04.596009 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:04.596011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:04.596055 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:04.596130 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:04.596535 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.597068 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.597813 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.598039 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.598117 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:04.600954 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:47763: BlockingRecv error: recv got EOF from 127.10.174.193:47763 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":103,"threads_started":1}
Aug 07 18:44:04 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:04 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:04.791154 20523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:04.785852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:58841)
0807 18:44:04.786115 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:04.786128 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:04.786222 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:04.786445 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:04.786447 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:04.786626 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:04.786723 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:04.786728 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.787541 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.787544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:04.788084 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:04.788092 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.788523 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.788526 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:04.788600 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:04.789081 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:04.789093 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:04.790968 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
W20260807 18:44:04.791218 20522 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:04.785939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58841 (local address 127.10.174.254:45657)
0807 18:44:04.786094 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:04.786097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:04.786192 (+ 95us) server_negotiation.cc:407] Connection header received
0807 18:44:04.786296 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:04.786298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:04.786342 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:04.786413 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:04.786827 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.787441 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.788192 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.788419 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.788498 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:04.791109 (+ 2611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:58841: BlockingRecv error: recv got EOF from 127.10.174.194:58841 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 18:44:04 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:04 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:04.970407 20524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:04.964796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:59085)
0807 18:44:04.965088 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:04.965102 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:04.965199 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:04.965441 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:04.965443 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:04.965615 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:04.965706 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:04.965710 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.966567 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.966569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:04.967159 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:04.967168 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.967622 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.967625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:04.967685 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:04.968168 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:04.968180 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:04.970298 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":65,"threads_started":1}
W20260807 18:44:04.970582 20522 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:04.964999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:59085 (local address 127.10.174.254:45657)
0807 18:44:04.965109 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:04.965112 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:04.965151 (+ 39us) server_negotiation.cc:407] Connection header received
0807 18:44:04.965294 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:04.965296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:04.965343 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:04.965408 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:04.965797 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.966473 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.967267 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:04.967526 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:04.967612 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:04.970425 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:59085: BlockingRecv error: recv got EOF from 127.10.174.195:59085 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 07 18:44:05 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:05 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:05.607273 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:05.601819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:40405)
0807 18:44:05.602113 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:05.602126 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:05.602221 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:05.602464 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:05.602466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:05.602717 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:05.602820 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:05.602826 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.603818 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.603824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:05.604416 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:05.604425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.604855 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.604857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:05.604920 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:05.605404 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:05.605415 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:05.607145 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":79,"threads_started":1}
W20260807 18:44:05.607487 20526 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:05.601877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:40405 (local address 127.10.174.254:45657)
0807 18:44:05.602175 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:05.602179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:05.602193 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:44:05.602314 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:05.602316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:05.602359 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:05.602429 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:05.602924 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.603695 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.604524 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.604755 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.604837 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:05.607329 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:40405: BlockingRecv error: recv got EOF from 127.10.174.193:40405 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":105,"threads_started":1}
Aug 07 18:44:05 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:05 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:05.797081 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:05.792087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:48421)
0807 18:44:05.792364 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:05.792378 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:05.792483 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:05.792714 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:05.792716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:05.792893 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:05.792986 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:05.792991 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.793690 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.793692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:05.794222 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:05.794228 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.794631 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.794634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:05.794691 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:05.795162 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:05.795174 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:05.796969 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":97,"threads_started":1}
W20260807 18:44:05.797267 20526 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:05.792140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:48421 (local address 127.10.174.254:45657)
0807 18:44:05.792290 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:05.792295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:05.792460 (+ 165us) server_negotiation.cc:407] Connection header received
0807 18:44:05.792564 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:05.792566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:05.792611 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:05.792681 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:05.793083 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.793601 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.794325 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.794539 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.794613 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:05.797100 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:48421: BlockingRecv error: recv got EOF from 127.10.174.194:48421 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 18:44:05 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:05 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:05.976980 20528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:05.971324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:53761)
0807 18:44:05.971597 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:05.971609 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:05.971756 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:05.972031 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:05.972034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:05.972264 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:05.972357 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:05.972363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.973226 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.973231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:05.973789 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:05.973797 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.974267 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.974270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:05.974359 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:05.974921 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:05.974933 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:05.976870 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":83,"threads_started":1}
W20260807 18:44:05.977171 20526 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:05.971366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:53761 (local address 127.10.174.254:45657)
0807 18:44:05.971527 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:05.971532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:05.971695 (+ 163us) server_negotiation.cc:407] Connection header received
0807 18:44:05.971864 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:05.971867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:05.971922 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:05.972010 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:05.972480 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.973098 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.973912 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:05.974145 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:05.974252 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:05.977004 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:53761: BlockingRecv error: recv got EOF from 127.10.174.195:53761 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 18:44:06 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:06 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:06.613401 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:06.608152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:47727)
0807 18:44:06.608445 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:06.608460 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:06.608565 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:06.608822 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:06.608824 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:06.609011 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:06.609115 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:06.609121 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.609835 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.609838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:06.610386 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:06.610393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.610797 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.610800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:06.610859 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:06.611471 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:06.611482 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:06.613287 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":114,"threads_started":1}
W20260807 18:44:06.613582 20530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:06.608241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:47727 (local address 127.10.174.254:45657)
0807 18:44:06.608486 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:06.608490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:06.608505 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:44:06.608653 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:06.608655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:06.608697 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:06.608782 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:06.609212 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.609730 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.610483 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.610698 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.610778 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:06.613411 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:47727: BlockingRecv error: recv got EOF from 127.10.174.193:47727 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":86,"threads_started":1}
Aug 07 18:44:06 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:06 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:06.802930 20531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:06.797842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:57857)
0807 18:44:06.798147 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:06.798160 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:06.798256 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:06.798445 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:06.798447 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:06.798641 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:06.798734 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:06.798740 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.799450 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.799453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:06.800053 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:06.800063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.800471 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.800474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:06.800537 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:06.801039 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:06.801052 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:06.802816 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":90,"threads_started":1}
W20260807 18:44:06.803059 20530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:06.797965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:57857 (local address 127.10.174.254:45657)
0807 18:44:06.798121 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:06.798125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:06.798229 (+ 104us) server_negotiation.cc:407] Connection header received
0807 18:44:06.798332 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:06.798334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:06.798376 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:06.798433 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:06.798828 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.799363 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.800157 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.800372 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.800444 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:06.802943 (+ 2499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:57857: BlockingRecv error: recv got EOF from 127.10.174.194:57857 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 18:44:06 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:06 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:06.983211 20532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:06.977728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:38359)
0807 18:44:06.978013 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:06.978031 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:06.978154 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:06.978438 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:06.978441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:06.978654 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:06.978744 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:06.978750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.979554 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.979559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:06.980121 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:06.980129 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.980592 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.980595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:06.980682 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:06.981238 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:06.981263 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:06.983042 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
W20260807 18:44:06.983268 20530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:06.977789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:38359 (local address 127.10.174.254:45657)
0807 18:44:06.977956 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:06.977963 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:06.978102 (+ 139us) server_negotiation.cc:407] Connection header received
0807 18:44:06.978262 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:06.978268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:06.978325 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:06.978412 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:06.978861 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.979447 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.980241 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:06.980476 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:06.980588 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:06.983161 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:38359: BlockingRecv error: recv got EOF from 127.10.174.195:38359 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 18:44:07 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:07 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:07.619765 20533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:07.614159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:59705)
0807 18:44:07.614449 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:07.614469 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:07.614602 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:07.614999 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:07.615001 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:07.615217 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:07.615347 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:07.615353 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.616153 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.616155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:07.616748 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:07.616755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.617178 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.617181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:07.617239 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:07.617706 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:07.617716 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:07.619643 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":80,"threads_started":1}
W20260807 18:44:07.619913 20534 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:07.614305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:59705 (local address 127.10.174.254:45657)
0807 18:44:07.614786 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:07.614789 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:07.614803 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:44:07.614838 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:07.614840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:07.614880 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:07.614962 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:07.615512 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.616054 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.616860 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.617075 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.617146 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:07.619779 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:59705: BlockingRecv error: recv got EOF from 127.10.174.193:59705 (error 108)
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":81,"threads_started":1}
Aug 07 18:44:07 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:07 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:07.813603 20535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:07.803874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:53827)
0807 18:44:07.804167 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:07.804180 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:07.804275 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:07.804488 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:07.804490 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:07.804681 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:07.804771 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:07.804777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.805479 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.805481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:07.806023 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:07.806030 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.806568 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.806572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:07.806637 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:07.811748 (+ 5111us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:07.811760 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:07.813491 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":84,"threads_started":1}
W20260807 18:44:07.813750 20534 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:07.803957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:53827 (local address 127.10.174.254:45657)
0807 18:44:07.804098 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:07.804102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:07.804254 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:44:07.804339 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:07.804341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:07.804383 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:07.804451 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:07.804875 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.805391 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.806159 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.806446 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.806555 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:07.813623 (+ 7068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:53827: BlockingRecv error: recv got EOF from 127.10.174.194:53827 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 18:44:07 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:07 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.195@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:07.989409 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:07.984178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.195:49237)
0807 18:44:07.984464 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:07.984478 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:07.984579 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:07.984802 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:07.984804 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:07.984984 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:07.985082 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:07.985086 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.985805 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.985807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:07.986352 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:07.986359 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.986752 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.986754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:07.986813 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:07.987423 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:07.987436 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:07.989296 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":110,"threads_started":1}
W20260807 18:44:07.989554 20534 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:07.984251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:49237 (local address 127.10.174.254:45657)
0807 18:44:07.984382 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:07.984385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:07.984529 (+ 144us) server_negotiation.cc:407] Connection header received
0807 18:44:07.984644 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:07.984646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:07.984692 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:07.984760 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:07.985178 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.985713 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.986448 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:07.986654 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:07.986729 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:07.989418 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.195:49237: BlockingRecv error: recv got EOF from 127.10.174.195:49237 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 18:44:08 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:08 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.193@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:08.626233 20537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:08.620697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.193:43329)
0807 18:44:08.621095 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:08.621114 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:08.621256 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:08.621509 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:08.621511 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:08.621689 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:08.621794 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:08.621799 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.622524 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.622526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:08.623071 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:08.623078 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.623524 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.623527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:08.623590 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:08.624095 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:08.624109 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:08.626119 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":128,"threads_started":1}
W20260807 18:44:08.626420 20538 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:08.620892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43329 (local address 127.10.174.254:45657)
0807 18:44:08.621160 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:08.621165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:08.621194 (+ 29us) server_negotiation.cc:407] Connection header received
0807 18:44:08.621348 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:08.621351 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:08.621393 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:08.621473 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:08.621897 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.622433 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.623178 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.623432 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.623506 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:08.626258 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.193:43329: BlockingRecv error: recv got EOF from 127.10.174.193:43329 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":71,"threads_started":1}
Aug 07 18:44:08 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 18:44:08 dist-test-slave-07c2 krb5kdc[19450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.174.194@KRBTEST.COM for oryx/127.10.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 18:44:08.820518 20539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:08.814592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:45657 (local address 127.10.174.194:38481)
0807 18:44:08.814929 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:08.814946 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:08.815109 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:08.815407 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:08.815410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:08.815628 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:08.815719 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:08.815725 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.816487 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.816493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:08.817062 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:08.817077 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.817539 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.817542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:08.817623 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:08.818235 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:08.818247 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:08.820363 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.174.254:45657: Server oryx/127.10.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":89,"threads_started":1}
W20260807 18:44:08.820678 20538 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:08.814738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:38481 (local address 127.10.174.254:45657)
0807 18:44:08.814924 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:08.814928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:08.815037 (+ 109us) server_negotiation.cc:407] Connection header received
0807 18:44:08.815215 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:08.815218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:08.815270 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:08.815378 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:08.815842 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.816379 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.817192 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:08.817426 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:08.817536 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:08.820519 (+ 2983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.174.194:38481: BlockingRecv error: recv got EOF from 127.10.174.194:38481 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 18:44:08.888517 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20047
I20260807 18:44:08.895210 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20206
I20260807 18:44:08.901240 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20342
I20260807 18:44:08.907419 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 19975
2026-08-07T18:44:08Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17953 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T18:44:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:44:08Z Disabled control of system clock
I20260807 18:44:08.939005 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:35283
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:46217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:35283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 18:44:09.048525 20543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:09.048772 20543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:09.048805 20543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:09.052738 20543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:44:09.052789 20543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:09.052804 20543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:09.052821 20543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:44:09.052879 20543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:44:09.057554 20543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:35283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:35283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:09.058542 20543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:09.059902 20543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:09.068122 20548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.068136 20549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.068235 20543 server_base.cc:1034] running on GCE node
W20260807 18:44:09.068401 20551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.068897 20543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:09.069967 20543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:09.071156 20543 hybrid_clock.cc:648] HybridClock initialized: now 1786128249071142 us; error 33 us; skew 500 ppm
I20260807 18:44:09.072993 20543 webserver.cc:460] Webserver started at http://127.10.174.254:46675/ using document root <none> and password file <none>
I20260807 18:44:09.073590 20543 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:09.073688 20543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:09.073925 20543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:09.076069 20543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "db9ddb95cc4244e2a9d439dc22722c19"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "130258d5867b7c60e0b687df3af65603"
server_key_iv: "89b9ed62af2f9bdaa3783e1cdb18ad70"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.076684 20543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "db9ddb95cc4244e2a9d439dc22722c19"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "130258d5867b7c60e0b687df3af65603"
server_key_iv: "89b9ed62af2f9bdaa3783e1cdb18ad70"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.080340 20543 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:44:09.082597 20557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.083827 20543 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:44:09.083971 20543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "db9ddb95cc4244e2a9d439dc22722c19"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "130258d5867b7c60e0b687df3af65603"
server_key_iv: "89b9ed62af2f9bdaa3783e1cdb18ad70"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.084086 20543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:09.107085 20543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:09.107846 20543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:09.108052 20543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:09.114888 20543 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:35283
I20260807 18:44:09.114917 20612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:35283 every 8 connection(s)
I20260807 18:44:09.115777 20543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:44:09.118804 20613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:09.124092 20613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19: Bootstrap starting.
I20260807 18:44:09.125001 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20543
I20260807 18:44:09.125137 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:44:09.125468 10939 external_mini_cluster.cc:1428] Setting key 392872ffac51564aca9cadf510dc7c29
I20260807 18:44:09.126960 20613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:09.127737 20613 log.cc:824] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:09.129594 20613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19: No bootstrap required, opened a new log
I20260807 18:44:09.133097 20613 raft_consensus.cc:348] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db9ddb95cc4244e2a9d439dc22722c19" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35283 } }
I20260807 18:44:09.133328 20613 raft_consensus.cc:374] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:09.133458 20613 raft_consensus.cc:729] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db9ddb95cc4244e2a9d439dc22722c19, State: Initialized, Role: FOLLOWER
I20260807 18:44:09.133912 20613 consensus_queue.cc:260] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db9ddb95cc4244e2a9d439dc22722c19" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35283 } }
I20260807 18:44:09.134073 20613 raft_consensus.cc:388] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:44:09.134140 20613 raft_consensus.cc:482] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:44:09.134231 20613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:09.134655 20616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.126516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59026 (local address 127.10.174.254:35283)
0807 18:44:09.127152 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:09.127166 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:09.127200 (+ 34us) server_negotiation.cc:407] Connection header received
0807 18:44:09.127889 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:09.127907 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:09.128361 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:09.128723 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:09.129132 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.130212 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.131154 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.131686 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.131862 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.132744 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:09.132754 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:09.132765 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:09.133116 (+ 351us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:09.133168 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:09.133187 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:09.133293 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:09.133479 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 18:44:09.133739 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":121,"threads_started":1}
I20260807 18:44:09.135306 20613 raft_consensus.cc:504] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db9ddb95cc4244e2a9d439dc22722c19" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35283 } }
I20260807 18:44:09.135643 20613 leader_election.cc:302] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db9ddb95cc4244e2a9d439dc22722c19; no voters:
I20260807 18:44:09.135965 20613 leader_election.cc:288] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:44:09.136068 20618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:44:09.136309 20618 raft_consensus.cc:686] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [term 1 LEADER]: Becoming Leader. State: Replica: db9ddb95cc4244e2a9d439dc22722c19, State: Running, Role: LEADER
I20260807 18:44:09.136659 20618 consensus_queue.cc:237] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db9ddb95cc4244e2a9d439dc22722c19" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35283 } }
I20260807 18:44:09.137333 20613 sys_catalog.cc:564] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:44:09.138211 20619 sys_catalog.cc:455] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db9ddb95cc4244e2a9d439dc22722c19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db9ddb95cc4244e2a9d439dc22722c19" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35283 } } }
I20260807 18:44:09.138334 20619 sys_catalog.cc:458] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:09.138626 20620 sys_catalog.cc:455] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db9ddb95cc4244e2a9d439dc22722c19. Latest consensus state: current_term: 1 leader_uuid: "db9ddb95cc4244e2a9d439dc22722c19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db9ddb95cc4244e2a9d439dc22722c19" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35283 } } }
I20260807 18:44:09.138737 20620 sys_catalog.cc:458] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:09.139472 20628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:44:09.142115 20628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:44:09.146869 20628 catalog_manager.cc:1347] Generated new cluster ID: 24ef1ee66c7348deac09f98b0b9665fa
I20260807 18:44:09.146931 20628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:44:09.158916 20628 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:44:09.159883 20628 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:44:09.163384 20628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db9ddb95cc4244e2a9d439dc22722c19: Generated new TSK 0
I20260807 18:44:09.164055 20628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:44:09.169111 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35283
--builtin_ntp_servers=127.10.174.212:46217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 18:44:09.279109 20638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:09.279400 20638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:09.279441 20638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:09.283380 20638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:09.283424 20638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:09.283475 20638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:44:09.288180 20638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:09.289109 20638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:09.290409 20638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:09.299382 20643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.299425 20646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.299386 20644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.299674 20638 server_base.cc:1034] running on GCE node
I20260807 18:44:09.300169 20638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:09.300765 20638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:09.301923 20638 hybrid_clock.cc:648] HybridClock initialized: now 1786128249301905 us; error 29 us; skew 500 ppm
I20260807 18:44:09.303709 20638 webserver.cc:460] Webserver started at http://127.10.174.193:46287/ using document root <none> and password file <none>
I20260807 18:44:09.304265 20638 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:09.304327 20638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:09.304569 20638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:09.306555 20638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "43edbaa295e149e4b2d1dac3895d0413"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "9b25578ed6dd5cedbaaf44ceade9b54a"
server_key_iv: "a7bc8fa504b1d99981036e7860af0dbe"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.307113 20638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "43edbaa295e149e4b2d1dac3895d0413"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "9b25578ed6dd5cedbaaf44ceade9b54a"
server_key_iv: "a7bc8fa504b1d99981036e7860af0dbe"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.310613 20638 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:44:09.313002 20652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.314152 20638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:44:09.314297 20638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "43edbaa295e149e4b2d1dac3895d0413"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "9b25578ed6dd5cedbaaf44ceade9b54a"
server_key_iv: "a7bc8fa504b1d99981036e7860af0dbe"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.314431 20638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:09.324842 20638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:09.325459 20638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:09.325649 20638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:09.326201 20638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:09.327087 20638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:09.327164 20638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.327255 20638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:09.327322 20638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.335743 20638 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:40867
I20260807 18:44:09.335821 20769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:40867 every 8 connection(s)
I20260807 18:44:09.336606 20638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:44:09.345665 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20638
I20260807 18:44:09.345799 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:44:09.346109 10939 external_mini_cluster.cc:1428] Setting key b10f7da4fcf776c790856ee487c39f60
I20260807 18:44:09.346127 20616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.338398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:49759 (local address 127.10.174.254:35283)
0807 18:44:09.338552 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:09.338587 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:09.339806 (+ 1219us) server_negotiation.cc:407] Connection header received
0807 18:44:09.341203 (+ 1397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:09.341206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:09.341265 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:09.341371 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:09.342221 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.342766 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.344142 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.344398 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.344524 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.345551 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:09.345554 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:09.345557 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:09.345580 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:09.345625 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:09.345633 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:09.345713 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:09.345916 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 18:44:09.345982 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:44:09.347047 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.338856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35283 (local address 127.10.174.193:49759)
0807 18:44:09.339607 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:09.339698 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:09.340992 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:09.341545 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:09.341551 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:09.341628 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:09.342076 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:09.342088 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.342903 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.342907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:09.343871 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:09.343881 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.344564 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.344568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:09.344746 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.345304 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:44:09.345306 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:09.345342 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:44:09.345399 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:09.345728 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:09.345740 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:09.345750 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 18:44:09.345911 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 18:44:09.346186 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":110,"threads_started":1}
I20260807 18:44:09.348213 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35283
--builtin_ntp_servers=127.10.174.212:46217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 18:44:09.348232 20770 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35283
I20260807 18:44:09.348459 20770 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:09.349040 20770 heartbeater.cc:511] Master 127.10.174.254:35283 requested a full tablet report, sending...
I20260807 18:44:09.350489 20575 ts_manager.cc:194] Registered new tserver with Master: 43edbaa295e149e4b2d1dac3895d0413 (127.10.174.193:40867)
I20260807 18:44:09.351672 20575 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.193:49759
W20260807 18:44:09.458649 20773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:09.458896 20773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:09.458931 20773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:09.462926 20773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:09.462977 20773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:09.463064 20773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:44:09.467788 20773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:09.468806 20773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:09.470120 20773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:09.479243 20781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.479256 20778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.479430 20773 server_base.cc:1034] running on GCE node
W20260807 18:44:09.479275 20779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.480012 20773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:09.480683 20773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:09.481875 20773 hybrid_clock.cc:648] HybridClock initialized: now 1786128249481859 us; error 29 us; skew 500 ppm
I20260807 18:44:09.483691 20773 webserver.cc:460] Webserver started at http://127.10.174.194:43683/ using document root <none> and password file <none>
I20260807 18:44:09.484262 20773 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:09.484355 20773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:09.484584 20773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:09.486580 20773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "b36b68a7be414bd5b63db98922a3ff74"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "255cdfa1f8aeeefa69b3c2696b689b8a"
server_key_iv: "3d915ad0bec3814ef2cc44db9069630a"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.487183 20773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "b36b68a7be414bd5b63db98922a3ff74"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "255cdfa1f8aeeefa69b3c2696b689b8a"
server_key_iv: "3d915ad0bec3814ef2cc44db9069630a"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.490926 20773 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:44:09.493451 20789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.494587 20773 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:44:09.494717 20773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "b36b68a7be414bd5b63db98922a3ff74"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "255cdfa1f8aeeefa69b3c2696b689b8a"
server_key_iv: "3d915ad0bec3814ef2cc44db9069630a"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.494838 20773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:09.516479 20773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:09.517156 20773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:09.517352 20773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:09.517911 20773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:09.518854 20773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:09.518899 20773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.518976 20773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:09.519016 20773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.527735 20773 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:32829
I20260807 18:44:09.527760 20907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:32829 every 8 connection(s)
I20260807 18:44:09.528631 20773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:44:09.535866 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20773
I20260807 18:44:09.535966 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:44:09.536345 10939 external_mini_cluster.cc:1428] Setting key 0f76f58bd284c4d04399e8434142b1a0
I20260807 18:44:09.538045 20616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.530396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:43497 (local address 127.10.174.254:35283)
0807 18:44:09.530557 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:09.530562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:09.531592 (+ 1030us) server_negotiation.cc:407] Connection header received
0807 18:44:09.533014 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:09.533017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:09.533075 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:09.533186 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:09.534060 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.534592 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.535809 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.536133 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.536223 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.537506 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:09.537509 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:09.537511 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:09.537522 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:09.537542 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:09.537550 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:09.537609 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:09.537811 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 18:44:09.537871 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:44:09.538573 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35283
--builtin_ntp_servers=127.10.174.212:46217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 18:44:09.539117 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.530765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35283 (local address 127.10.174.194:43497)
0807 18:44:09.531449 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:09.531489 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:09.532804 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:09.533353 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:09.533360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:09.533438 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:09.533909 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:09.533922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.534727 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.534735 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:09.535680 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:09.535695 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.536295 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.536302 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:09.536507 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.537239 (+ 732us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:44:09.537241 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:09.537291 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:44:09.537365 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:09.537635 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:09.537644 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:09.537649 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 18:44:09.537810 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 18:44:09.538128 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":114,"threads_started":1}
I20260807 18:44:09.540207 20908 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35283
I20260807 18:44:09.540477 20908 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:09.540992 20908 heartbeater.cc:511] Master 127.10.174.254:35283 requested a full tablet report, sending...
I20260807 18:44:09.542037 20575 ts_manager.cc:194] Registered new tserver with Master: b36b68a7be414bd5b63db98922a3ff74 (127.10.174.194:32829)
I20260807 18:44:09.542632 20575 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.194:43497
W20260807 18:44:09.652181 20911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:09.652416 20911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:09.652475 20911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:09.656447 20911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:09.656507 20911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:09.656558 20911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:44:09.661135 20911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:09.662125 20911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:09.663847 20911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:09.673065 20917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.673301 20919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.673380 20916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.673542 20911 server_base.cc:1034] running on GCE node
I20260807 18:44:09.674005 20911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:09.674747 20911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:09.675957 20911 hybrid_clock.cc:648] HybridClock initialized: now 1786128249675952 us; error 30 us; skew 500 ppm
I20260807 18:44:09.677631 20911 webserver.cc:460] Webserver started at http://127.10.174.195:42525/ using document root <none> and password file <none>
I20260807 18:44:09.678174 20911 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:09.678236 20911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:09.678484 20911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:09.680428 20911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "a34b193bcd654461975e6591b5ac6168"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "312f30ede97d64f36985a72a8754efc4"
server_key_iv: "1ca791c7606a31193111b7ee3a7a3459"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.680974 20911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "a34b193bcd654461975e6591b5ac6168"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "312f30ede97d64f36985a72a8754efc4"
server_key_iv: "1ca791c7606a31193111b7ee3a7a3459"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.684326 20911 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:44:09.686559 20925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.687812 20911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:44:09.687940 20911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "a34b193bcd654461975e6591b5ac6168"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "312f30ede97d64f36985a72a8754efc4"
server_key_iv: "1ca791c7606a31193111b7ee3a7a3459"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.688048 20911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:09.705037 20911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:09.705575 20911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:09.705708 20911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:09.706190 20911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:09.706990 20911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:09.707036 20911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.707072 20911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:09.707093 20911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.715512 20911 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:33333
I20260807 18:44:09.715539 21043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:33333 every 8 connection(s)
I20260807 18:44:09.716326 20911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:44:09.724735 20616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.718124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:39579 (local address 127.10.174.254:35283)
0807 18:44:09.718299 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:09.718305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:09.719233 (+ 928us) server_negotiation.cc:407] Connection header received
0807 18:44:09.720554 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:09.720556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:09.720600 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:09.720672 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:09.721469 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.721981 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.723032 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.723385 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.723463 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.724388 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:09.724391 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:09.724393 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:09.724404 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:09.724419 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:09.724426 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:09.724481 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:09.724583 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 18:44:09.724627 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:44:09.725461 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 20911
I20260807 18:44:09.725528 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.718474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35283 (local address 127.10.174.195:39579)
0807 18:44:09.719112 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:09.719150 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:09.720376 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:09.720809 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:09.720815 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:09.720888 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:09.721352 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:09.721364 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.722086 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.722088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:09.722931 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:09.722940 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:09.723502 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:09.723505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:09.723637 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:09.724162 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:44:09.724164 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:09.724200 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:44:09.724258 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:09.724480 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:09.724484 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:09.724487 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 18:44:09.724566 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 18:44:09.724776 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":110,"threads_started":1}
I20260807 18:44:09.725586 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:44:09.725931 10939 external_mini_cluster.cc:1428] Setting key 1b051ac7c3574ed943af8d00ad7ec5ee
I20260807 18:44:09.726687 21044 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35283
I20260807 18:44:09.726897 21044 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:09.727425 21044 heartbeater.cc:511] Master 127.10.174.254:35283 requested a full tablet report, sending...
I20260807 18:44:09.728351 20575 ts_manager.cc:194] Registered new tserver with Master: a34b193bcd654461975e6591b5ac6168 (127.10.174.195:33333)
I20260807 18:44:09.728894 20575 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.195:39579
I20260807 18:44:09.739442 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 18:44:09.742192 20616 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:09.741251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59042 (local address 127.10.174.254:35283)
0807 18:44:09.741391 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:09.741396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:09.741575 (+ 179us) server_negotiation.cc:407] Connection header received
0807 18:44:09.741693 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:09.741695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:09.741734 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:09.741831 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:09.742080 (+ 249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59042: BlockingRecv error: recv got EOF from 127.0.0.1:59042 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:44:09.742347 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20638
I20260807 18:44:09.750365 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20773
I20260807 18:44:09.756886 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20911
I20260807 18:44:09.762476 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 20543
2026-08-07T18:44:09Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (853 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T18:44:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:44:09Z Disabled control of system clock
I20260807 18:44:09.792259 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:41059
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:41059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 18:44:09.899061 21055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:09.899377 21055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:09.899430 21055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:09.903304 21055 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:44:09.903353 21055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:09.903368 21055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:09.903384 21055 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:44:09.903398 21055 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:44:09.908030 21055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:41059
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:41059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:09.909034 21055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:09.910317 21055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:09.918282 21063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:09.918310 21060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.918346 21055 server_base.cc:1034] running on GCE node
W20260807 18:44:09.918301 21061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:09.919032 21055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:09.920120 21055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:09.921303 21055 hybrid_clock.cc:648] HybridClock initialized: now 1786128249921283 us; error 42 us; skew 500 ppm
I20260807 18:44:09.922974 21055 webserver.cc:460] Webserver started at http://127.10.174.254:41715/ using document root <none> and password file <none>
I20260807 18:44:09.923624 21055 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:09.923718 21055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:09.923940 21055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:09.925863 21055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "91523fe10e23453cb0cc7bc61a42c890"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "a746fc38d3e9829494e1be0e0e81eea8"
server_key_iv: "de79d645203ddc040c8375d6b0fa0691"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.926424 21055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "91523fe10e23453cb0cc7bc61a42c890"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "a746fc38d3e9829494e1be0e0e81eea8"
server_key_iv: "de79d645203ddc040c8375d6b0fa0691"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.929942 21055 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:44:09.932314 21069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:09.933444 21055 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:44:09.933581 21055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "91523fe10e23453cb0cc7bc61a42c890"
format_stamp: "Formatted at 2026-08-07 18:44:09 on dist-test-slave-07c2"
server_key: "a746fc38d3e9829494e1be0e0e81eea8"
server_key_iv: "de79d645203ddc040c8375d6b0fa0691"
server_key_version: "encryptionkey@0"
I20260807 18:44:09.933692 21055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:09.938113 21055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:09.938670 21055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:09.938845 21055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:09.945652 21055 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:41059
I20260807 18:44:09.945662 21123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:41059 every 8 connection(s)
I20260807 18:44:09.946516 21055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:44:09.947256 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21055
I20260807 18:44:09.947418 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:44:09.947707 10939 external_mini_cluster.cc:1428] Setting key 8d6cd612f9c3a8bebecb942424abc482
I20260807 18:44:09.949846 21124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:09.954488 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:09.949177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52940 (local address 127.10.174.254:41059)
0807 18:44:09.950246 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:09.950272 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:09.950316 (+ 44us) server_negotiation.cc:407] Connection header received
0807 18:44:09.951249 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:09.951272 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:09.951767 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:09.952149 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:09.952912 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:09.952920 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:09.952935 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:09.952947 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:09.953010 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:09.953033 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:09.953186 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:09.953263 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 18:44:09.953522 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":484,"threads_started":1}
I20260807 18:44:09.957252 21124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890: Bootstrap starting.
I20260807 18:44:09.959779 21124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:09.960513 21124 log.cc:824] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:09.962265 21124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890: No bootstrap required, opened a new log
I20260807 18:44:09.965797 21124 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91523fe10e23453cb0cc7bc61a42c890" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41059 } }
I20260807 18:44:09.965996 21124 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:09.966070 21124 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91523fe10e23453cb0cc7bc61a42c890, State: Initialized, Role: FOLLOWER
I20260807 18:44:09.966449 21124 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91523fe10e23453cb0cc7bc61a42c890" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41059 } }
I20260807 18:44:09.966588 21124 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:44:09.966651 21124 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:44:09.966774 21124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:09.967672 21124 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91523fe10e23453cb0cc7bc61a42c890" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41059 } }
I20260807 18:44:09.967984 21124 leader_election.cc:302] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91523fe10e23453cb0cc7bc61a42c890; no voters:
I20260807 18:44:09.968286 21124 leader_election.cc:288] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:44:09.968423 21129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:44:09.968683 21129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [term 1 LEADER]: Becoming Leader. State: Replica: 91523fe10e23453cb0cc7bc61a42c890, State: Running, Role: LEADER
I20260807 18:44:09.968991 21129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91523fe10e23453cb0cc7bc61a42c890" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41059 } }
I20260807 18:44:09.969432 21124 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:44:09.970521 21131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91523fe10e23453cb0cc7bc61a42c890. Latest consensus state: current_term: 1 leader_uuid: "91523fe10e23453cb0cc7bc61a42c890" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91523fe10e23453cb0cc7bc61a42c890" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41059 } } }
I20260807 18:44:09.970661 21131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:09.970932 21130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91523fe10e23453cb0cc7bc61a42c890" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91523fe10e23453cb0cc7bc61a42c890" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41059 } } }
I20260807 18:44:09.971050 21130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:09.971611 21134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:44:09.973917 21134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:44:09.978659 21134 catalog_manager.cc:1347] Generated new cluster ID: 3d8f10565e114e72840f96011e3f6cac
I20260807 18:44:09.978720 21134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:44:09.993685 21134 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:44:09.994006 21134 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:44:10.005141 21134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91523fe10e23453cb0cc7bc61a42c890: Generated new TSK 0
I20260807 18:44:10.005764 21134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:44:10.015956 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41059
--builtin_ntp_servers=127.10.174.212:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 18:44:10.123943 21148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:10.124228 21148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:10.124266 21148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:10.128101 21148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:10.128140 21148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:10.128191 21148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:44:10.132799 21148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:10.133708 21148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:10.134960 21148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:10.144624 21153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:10.144644 21154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:10.144801 21148 server_base.cc:1034] running on GCE node
W20260807 18:44:10.144626 21156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:10.145336 21148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:10.145957 21148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:10.147135 21148 hybrid_clock.cc:648] HybridClock initialized: now 1786128250147105 us; error 44 us; skew 500 ppm
I20260807 18:44:10.149071 21148 webserver.cc:460] Webserver started at http://127.10.174.193:38591/ using document root <none> and password file <none>
I20260807 18:44:10.149639 21148 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:10.149736 21148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:10.149973 21148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:10.152112 21148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "66a6d2ada66c4785a82d48a5f65ec21d"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "f9b9631acf44b626cff9e741fd575fc8"
server_key_iv: "9cbc7cf7f52a7bb03afee5fa1246d434"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.152680 21148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "66a6d2ada66c4785a82d48a5f65ec21d"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "f9b9631acf44b626cff9e741fd575fc8"
server_key_iv: "9cbc7cf7f52a7bb03afee5fa1246d434"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.156407 21148 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:44:10.158819 21162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.159976 21148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:44:10.160111 21148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "66a6d2ada66c4785a82d48a5f65ec21d"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "f9b9631acf44b626cff9e741fd575fc8"
server_key_iv: "9cbc7cf7f52a7bb03afee5fa1246d434"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.160229 21148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:10.164765 21148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:10.165354 21148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:10.165537 21148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:10.166070 21148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:10.166949 21148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:10.167018 21148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.167088 21148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:10.167131 21148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.176285 21148 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:38921
I20260807 18:44:10.176333 21278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:38921 every 8 connection(s)
I20260807 18:44:10.177124 21148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:44:10.182523 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21148
I20260807 18:44:10.182680 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:44:10.182842 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:10.178820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:49273 (local address 127.10.174.254:41059)
0807 18:44:10.178997 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:10.179002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:10.179951 (+ 949us) server_negotiation.cc:407] Connection header received
0807 18:44:10.181141 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:10.181143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:10.181185 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:10.181257 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:10.182337 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:10.182343 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:10.182350 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:10.182367 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:10.182395 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:10.182408 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:10.182517 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:10.182648 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 18:44:10.182709 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 18:44:10.183072 10939 external_mini_cluster.cc:1428] Setting key d3934930e56e9c0ce5d3cd6bd77d75e2
I20260807 18:44:10.183840 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:10.179191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:41059 (local address 127.10.174.193:49273)
0807 18:44:10.179812 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:10.179849 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:10.180963 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:10.181374 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:10.181379 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:10.181456 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:10.182056 (+ 600us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:44:10.182058 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:10.182095 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:44:10.182159 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:10.182505 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:10.182512 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:10.182516 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:44:10.182668 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 18:44:10.182928 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":106,"threads_started":1}
I20260807 18:44:10.185029 21279 heartbeater.cc:347] Connected to a master server at 127.10.174.254:41059
I20260807 18:44:10.185302 21279 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:10.185283 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41059
--builtin_ntp_servers=127.10.174.212:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 18:44:10.185750 21279 heartbeater.cc:511] Master 127.10.174.254:41059 requested a full tablet report, sending...
I20260807 18:44:10.187384 21087 ts_manager.cc:194] Registered new tserver with Master: 66a6d2ada66c4785a82d48a5f65ec21d (127.10.174.193:38921)
W20260807 18:44:10.295871 21282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:10.296103 21282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:10.296140 21282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:10.299986 21282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:10.300024 21282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:10.300076 21282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:44:10.304627 21282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:10.305516 21282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:10.306763 21282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:10.315487 21290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:10.315577 21287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:10.315493 21288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:10.315696 21282 server_base.cc:1034] running on GCE node
I20260807 18:44:10.316134 21282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:10.316700 21282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:10.317865 21282 hybrid_clock.cc:648] HybridClock initialized: now 1786128250317847 us; error 30 us; skew 500 ppm
I20260807 18:44:10.319677 21282 webserver.cc:460] Webserver started at http://127.10.174.194:33643/ using document root <none> and password file <none>
I20260807 18:44:10.320209 21282 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:10.320272 21282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:10.320513 21282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:10.322480 21282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "e02e9f54f5e649889b29b53fa8c1d96a"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "4048a1b98062f6b5ccc7e51199e596b5"
server_key_iv: "2c3e84538e0d7624876897334229523f"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.323057 21282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "e02e9f54f5e649889b29b53fa8c1d96a"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "4048a1b98062f6b5ccc7e51199e596b5"
server_key_iv: "2c3e84538e0d7624876897334229523f"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.326634 21282 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:44:10.329079 21296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.330224 21282 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:44:10.330353 21282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "e02e9f54f5e649889b29b53fa8c1d96a"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "4048a1b98062f6b5ccc7e51199e596b5"
server_key_iv: "2c3e84538e0d7624876897334229523f"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.330462 21282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:10.334717 21282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:10.335319 21282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:10.335498 21282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:10.336004 21282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:10.336908 21282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:10.336972 21282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.337033 21282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:10.337081 21282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.346076 21282 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:37899
I20260807 18:44:10.346101 21411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:37899 every 8 connection(s)
I20260807 18:44:10.346892 21282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:44:10.352347 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21282
I20260807 18:44:10.352489 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:44:10.352798 10939 external_mini_cluster.cc:1428] Setting key 6a628b93aa48dc9fe6edcf3bb3cfbc9f
I20260807 18:44:10.352850 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:10.348709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:35789 (local address 127.10.174.254:41059)
0807 18:44:10.348855 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:10.348859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:10.349800 (+ 941us) server_negotiation.cc:407] Connection header received
0807 18:44:10.351062 (+ 1262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:10.351065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:10.351109 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:10.351220 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:10.352311 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:10.352314 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:10.352317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:10.352329 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:10.352352 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:10.352368 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:10.352473 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:10.352664 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 18:44:10.352709 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:44:10.353717 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:10.349049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:41059 (local address 127.10.174.194:35789)
0807 18:44:10.349656 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:10.349693 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:10.350864 (+ 1171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:10.351403 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:10.351410 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:10.351488 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:10.352054 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:44:10.352056 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:10.352092 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:44:10.352155 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:10.352488 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:10.352500 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:10.352510 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 18:44:10.352705 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 18:44:10.352917 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":130,"threads_started":1}
I20260807 18:44:10.354815 21412 heartbeater.cc:347] Connected to a master server at 127.10.174.254:41059
I20260807 18:44:10.354946 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41059
--builtin_ntp_servers=127.10.174.212:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 18:44:10.355062 21412 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:10.355489 21412 heartbeater.cc:511] Master 127.10.174.254:41059 requested a full tablet report, sending...
I20260807 18:44:10.356453 21087 ts_manager.cc:194] Registered new tserver with Master: e02e9f54f5e649889b29b53fa8c1d96a (127.10.174.194:37899)
W20260807 18:44:10.466320 21415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:10.466549 21415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:10.466595 21415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:10.470840 21415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:10.470896 21415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:10.470988 21415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:44:10.475827 21415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:41059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:10.476724 21415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:10.477938 21415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:44:10.486943 21415 server_base.cc:1034] running on GCE node
W20260807 18:44:10.486934 21420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:10.486910 21423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:10.487258 21421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:10.487699 21415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:10.488286 21415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:10.489465 21415 hybrid_clock.cc:648] HybridClock initialized: now 1786128250489448 us; error 32 us; skew 500 ppm
I20260807 18:44:10.491178 21415 webserver.cc:460] Webserver started at http://127.10.174.195:42869/ using document root <none> and password file <none>
I20260807 18:44:10.491755 21415 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:10.491845 21415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:10.492063 21415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:10.493949 21415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "7a5845d367364fa7800fdb8b5bce4fb5"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "558404cb968224ae0d5a664211c2d6ce"
server_key_iv: "1ad0f2cd7b90b447f447af6e3d8edeb4"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.494501 21415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "7a5845d367364fa7800fdb8b5bce4fb5"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "558404cb968224ae0d5a664211c2d6ce"
server_key_iv: "1ad0f2cd7b90b447f447af6e3d8edeb4"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.497938 21415 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:44:10.500280 21429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.501389 21415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:44:10.501516 21415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "7a5845d367364fa7800fdb8b5bce4fb5"
format_stamp: "Formatted at 2026-08-07 18:44:10 on dist-test-slave-07c2"
server_key: "558404cb968224ae0d5a664211c2d6ce"
server_key_iv: "1ad0f2cd7b90b447f447af6e3d8edeb4"
server_key_version: "encryptionkey@0"
I20260807 18:44:10.501622 21415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:10.506693 21415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:10.507371 21415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:10.507571 21415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:10.508131 21415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:10.509066 21415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:10.509142 21415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.509218 21415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:10.509275 21415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:10.518328 21415 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:40011
I20260807 18:44:10.518356 21546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:40011 every 8 connection(s)
I20260807 18:44:10.519162 21415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:44:10.521358 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21415
I20260807 18:44:10.521481 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:44:10.521828 10939 external_mini_cluster.cc:1428] Setting key 7fae2ee1bca80e8427704c683be8fce4
I20260807 18:44:10.525768 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:10.520935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:48879 (local address 127.10.174.254:41059)
0807 18:44:10.521077 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:10.521081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:10.522259 (+ 1178us) server_negotiation.cc:407] Connection header received
0807 18:44:10.524034 (+ 1775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:10.524038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:10.524102 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:10.524187 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:10.525299 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:10.525303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:10.525306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:44:10.525318 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:10.525341 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:44:10.525357 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:10.525448 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:10.525596 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 18:44:10.525641 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:44:10.526551 21550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:10.521289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:41059 (local address 127.10.174.195:48879)
0807 18:44:10.522085 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:10.522141 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:10.523798 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:10.524390 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:10.524400 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:10.524500 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:10.525059 (+ 559us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:44:10.525060 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:10.525097 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:44:10.525161 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:10.525438 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:10.525446 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:10.525452 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:44:10.525627 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 18:44:10.525878 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":145,"threads_started":1}
I20260807 18:44:10.527571 21547 heartbeater.cc:347] Connected to a master server at 127.10.174.254:41059
I20260807 18:44:10.527787 21547 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:10.528157 21547 heartbeater.cc:511] Master 127.10.174.254:41059 requested a full tablet report, sending...
I20260807 18:44:10.529086 21087 ts_manager.cc:194] Registered new tserver with Master: 7a5845d367364fa7800fdb8b5bce4fb5 (127.10.174.195:40011)
I20260807 18:44:10.535907 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 18:44:10.538580 21127 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:44:10.537736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.10.174.254:41059)
0807 18:44:10.537854 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:10.537857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:10.538110 (+ 253us) server_negotiation.cc:407] Connection header received
0807 18:44:10.538206 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:10.538208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:10.538239 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:10.538304 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:10.538494 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52952: BlockingRecv error: recv got EOF from 127.0.0.1:52952 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:44:10.538915 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21148
I20260807 18:44:10.547605 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21282
I20260807 18:44:10.553560 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21415
I20260807 18:44:10.559340 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21055
2026-08-07T18:44:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (796 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:44:10 dist-test-slave-07c2 krb5kdc[21558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:44:10 dist-test-slave-07c2 krb5kdc[21558](info): set up 2 sockets
Aug 07 18:44:10 dist-test-slave-07c2 krb5kdc[21558](info): commencing operation
krb5kdc: starting...
W20260807 18:44:11.626941 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:44:11 dist-test-slave-07c2 krb5kdc[21558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:44:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:44:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:44:11.750586 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:35253
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:35253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:11.857158 21572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:11.857390 21572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:11.857429 21572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:11.861562 21572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:44:11.861629 21572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:11.861649 21572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:11.861665 21572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:44:11.861680 21572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:44:11.867251 21572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:35253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:35253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:11.868157 21572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:11.869093 21572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:11.877313 21581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:11.877373 21578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:11.877574 21572 server_base.cc:1034] running on GCE node
W20260807 18:44:11.877584 21579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:11.878232 21572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:11.879452 21572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:11.880627 21572 hybrid_clock.cc:648] HybridClock initialized: now 1786128251880609 us; error 33 us; skew 500 ppm
Aug 07 18:44:11 dist-test-slave-07c2 krb5kdc[21558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128251, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:11.883466 21572 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:44:11.884298 21572 webserver.cc:460] Webserver started at http://127.10.174.254:35867/ using document root <none> and password file <none>
I20260807 18:44:11.884828 21572 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:11.884917 21572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:11.885129 21572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:11.887126 21572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "40fe8f0ae212443199d844ac17718f69"
format_stamp: "Formatted at 2026-08-07 18:44:11 on dist-test-slave-07c2"
server_key: "efe9c18a0dcea09f56a51ed719639de3"
server_key_iv: "cab1bb508ee76a160c83c833504b1186"
server_key_version: "encryptionkey@0"
I20260807 18:44:11.887754 21572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "40fe8f0ae212443199d844ac17718f69"
format_stamp: "Formatted at 2026-08-07 18:44:11 on dist-test-slave-07c2"
server_key: "efe9c18a0dcea09f56a51ed719639de3"
server_key_iv: "cab1bb508ee76a160c83c833504b1186"
server_key_version: "encryptionkey@0"
I20260807 18:44:11.891211 21572 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:44:11.893469 21588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:11.894557 21572 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:44:11.894701 21572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "40fe8f0ae212443199d844ac17718f69"
format_stamp: "Formatted at 2026-08-07 18:44:11 on dist-test-slave-07c2"
server_key: "efe9c18a0dcea09f56a51ed719639de3"
server_key_iv: "cab1bb508ee76a160c83c833504b1186"
server_key_version: "encryptionkey@0"
I20260807 18:44:11.894806 21572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:11.906591 21572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:11.909085 21572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:11.909273 21572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:11.915766 21572 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:35253
I20260807 18:44:11.916040 21642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:35253 every 8 connection(s)
I20260807 18:44:11.916683 21572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:44:11.919113 21643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:11.924089 21643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69: Bootstrap starting.
I20260807 18:44:11.926146 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21572
I20260807 18:44:11.926249 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:44:11.926258 21643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:11.926512 10939 external_mini_cluster.cc:1428] Setting key c5c3eba027e48ab57c8f34fd3349b7c9
I20260807 18:44:11.927006 21643 log.cc:824] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:11.928893 21643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69: No bootstrap required, opened a new log
I20260807 18:44:11.932945 21643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fe8f0ae212443199d844ac17718f69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35253 } }
I20260807 18:44:11.933219 21643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:11.933290 21643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40fe8f0ae212443199d844ac17718f69, State: Initialized, Role: FOLLOWER
I20260807 18:44:11.933759 21643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fe8f0ae212443199d844ac17718f69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35253 } }
I20260807 18:44:11.933939 21643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:44:11.934016 21643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:44:11.934127 21643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:11.935213 21643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fe8f0ae212443199d844ac17718f69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35253 } }
Aug 07 18:44:11 dist-test-slave-07c2 krb5kdc[21558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:11.935592 21643 leader_election.cc:302] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40fe8f0ae212443199d844ac17718f69; no voters:
I20260807 18:44:11.935956 21643 leader_election.cc:288] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:44:11.936049 21648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:44:11.936262 21648 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [term 1 LEADER]: Becoming Leader. State: Replica: 40fe8f0ae212443199d844ac17718f69, State: Running, Role: LEADER
I20260807 18:44:11.936822 21648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fe8f0ae212443199d844ac17718f69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35253 } }
I20260807 18:44:11.937359 21643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:44:11.938706 21650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40fe8f0ae212443199d844ac17718f69. Latest consensus state: current_term: 1 leader_uuid: "40fe8f0ae212443199d844ac17718f69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fe8f0ae212443199d844ac17718f69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35253 } } }
I20260807 18:44:11.938867 21650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:11.938706 21649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40fe8f0ae212443199d844ac17718f69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40fe8f0ae212443199d844ac17718f69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 35253 } } }
I20260807 18:44:11.938982 21649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:11.939664 21659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:44:11.941838 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:11.927606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44364 (local address 127.10.174.254:35253)
0807 18:44:11.928043 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:11.928058 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:11.928090 (+ 32us) server_negotiation.cc:407] Connection header received
0807 18:44:11.928694 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:11.928714 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:11.929042 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:11.929311 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:11.930182 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:11.931102 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:11.932383 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:11.932832 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:11.932946 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:11.936008 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:11.936017 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:11.936032 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:11.936069 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:11.938133 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:11.938700 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:11.938706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:11.938712 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:11.938962 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:11.939351 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:11.939357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:11.939360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:11.939923 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:11.940155 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:11.940557 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 18:44:11.940864 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":139,"threads_started":1}
I20260807 18:44:11.943988 21659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:44:11.949401 21659 catalog_manager.cc:1347] Generated new cluster ID: 2fcdf46266024ad4a68c57ba8fd98efb
I20260807 18:44:11.949470 21659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:44:11.964246 21659 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:44:11.965118 21659 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:44:11.974476 21659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69: Generated new TSK 0
I20260807 18:44:11.975126 21659 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:44:12.013721 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35253
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:12.136716 21670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:12.136948 21670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:12.136989 21670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:12.141036 21670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:12.141093 21670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:12.141147 21670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:44:12.146212 21670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:12.147123 21670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:12.148123 21670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:12.157534 21676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:12.157552 21675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:12.157572 21670 server_base.cc:1034] running on GCE node
W20260807 18:44:12.157539 21678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:12.158071 21670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:12.158610 21670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:12.159765 21670 hybrid_clock.cc:648] HybridClock initialized: now 1786128252159753 us; error 25 us; skew 500 ppm
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[21558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128252, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:12.162570 21670 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:44:12.163415 21670 webserver.cc:460] Webserver started at http://127.10.174.193:44807/ using document root <none> and password file <none>
I20260807 18:44:12.163935 21670 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:12.163995 21670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:12.164204 21670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:12.166088 21670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "11b1410529714f33a11a9a31c98d37ae"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "8b5cbb18b903b02afb32944320a35556"
server_key_iv: "957ceec6229cfa506df41326c383adda"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.166630 21670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "11b1410529714f33a11a9a31c98d37ae"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "8b5cbb18b903b02afb32944320a35556"
server_key_iv: "957ceec6229cfa506df41326c383adda"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.170113 21670 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 18:44:12.172351 21685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.173452 21670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:44:12.173583 21670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "11b1410529714f33a11a9a31c98d37ae"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "8b5cbb18b903b02afb32944320a35556"
server_key_iv: "957ceec6229cfa506df41326c383adda"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.173688 21670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:12.183157 21670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:12.185695 21670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:12.185887 21670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:12.186420 21670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:12.187173 21670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:12.187238 21670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.187358 21670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:12.187400 21670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.195835 21670 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:32919
I20260807 18:44:12.195894 21804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:32919 every 8 connection(s)
I20260807 18:44:12.196682 21670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:44:12.200656 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21670
I20260807 18:44:12.200788 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:44:12.201071 10939 external_mini_cluster.cc:1428] Setting key a176913293299a00d118be690a897f7c
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[21558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128252, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:12.211627 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.198462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:55053 (local address 127.10.174.254:35253)
0807 18:44:12.198622 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.198628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.199519 (+ 891us) server_negotiation.cc:407] Connection header received
0807 18:44:12.200847 (+ 1328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.200851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.200913 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.201021 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:12.202291 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.202874 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.204683 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.204926 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.205038 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.207883 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:12.207886 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:12.207889 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:12.207911 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:12.209400 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.210008 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.210010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.210011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.210085 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.210471 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.210473 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.210474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.210637 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:12.210709 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.211403 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.211505 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:44:12.212564 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.198883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35253 (local address 127.10.174.193:55053)
0807 18:44:12.199365 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.199420 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.200625 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.201214 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.201222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.201596 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:12.202103 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.202116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.203007 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.203013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.204546 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.204561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.205072 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.205076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.205244 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.205834 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:12.205849 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:12.207717 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:12.209519 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:12.209526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:12.209543 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:12.209902 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:12.210172 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:12.210177 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:12.210181 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:12.210374 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:12.210746 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:12.210755 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:12.211086 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.211357 (+ 271us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.211715 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":114,"threads_started":1}
I20260807 18:44:12.213737 21805 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35253
I20260807 18:44:12.213986 21805 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:44:12.214542 21805 heartbeater.cc:511] Master 127.10.174.254:35253 requested a full tablet report, sending...
I20260807 18:44:12.216092 21605 ts_manager.cc:194] Registered new tserver with Master: 11b1410529714f33a11a9a31c98d37ae (127.10.174.193:32919)
I20260807 18:44:12.217351 21605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:55053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:44:12.230214 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35253
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:12.339349 21810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:12.339612 21810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:12.339689 21810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:12.343748 21810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:12.343812 21810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:12.343912 21810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:44:12.349320 21810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:12.350437 21810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:12.351507 21810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:12.361012 21815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:12.361021 21818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:12.361109 21810 server_base.cc:1034] running on GCE node
W20260807 18:44:12.361021 21816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:12.361742 21810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:12.362336 21810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:12.363510 21810 hybrid_clock.cc:648] HybridClock initialized: now 1786128252363496 us; error 28 us; skew 500 ppm
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[21558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128252, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:12.366019 21810 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:44:12.366797 21810 webserver.cc:460] Webserver started at http://127.10.174.194:43359/ using document root <none> and password file <none>
I20260807 18:44:12.367372 21810 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:12.367458 21810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:12.367671 21810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:12.369596 21810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "e4d5fca34b124fee90088380ba970fac"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "124509ae6c559610f87a9282ca0deaca"
server_key_iv: "4cb3f0e3cdb99f5dbc65fc32a7edde3b"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.370152 21810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "e4d5fca34b124fee90088380ba970fac"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "124509ae6c559610f87a9282ca0deaca"
server_key_iv: "4cb3f0e3cdb99f5dbc65fc32a7edde3b"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.373637 21810 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:44:12.375877 21825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.377018 21810 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:44:12.377140 21810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "e4d5fca34b124fee90088380ba970fac"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "124509ae6c559610f87a9282ca0deaca"
server_key_iv: "4cb3f0e3cdb99f5dbc65fc32a7edde3b"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.377281 21810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:12.415045 21810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:12.418088 21810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:12.418303 21810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:12.419124 21810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:12.420023 21810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:12.420090 21810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.420154 21810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:12.420184 21810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.428813 21810 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:36175
I20260807 18:44:12.428845 21942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:36175 every 8 connection(s)
I20260807 18:44:12.429656 21810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:44:12.437095 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21810
I20260807 18:44:12.437207 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:44:12.437530 10939 external_mini_cluster.cc:1428] Setting key 386f2384467fbc3ad250b8a8e027c0e0
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[21558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128252, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:12.443629 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.431265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58357 (local address 127.10.174.254:35253)
0807 18:44:12.431439 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.431443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.432223 (+ 780us) server_negotiation.cc:407] Connection header received
0807 18:44:12.433577 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.433580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.433639 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.433727 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:12.434820 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.435427 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.436529 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.436774 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.436905 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.439782 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:12.439786 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:12.439788 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:12.439814 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:12.441533 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.442035 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.442040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.442042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.442142 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.442548 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.442551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.442552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.442743 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:12.442819 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.443415 (+ 596us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.443513 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 18:44:12.444798 21945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.431617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35253 (local address 127.10.174.194:58357)
0807 18:44:12.432066 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.432108 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.433381 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.433895 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.433901 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.434239 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:12.434682 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.434694 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.435545 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.435553 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.436407 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.436416 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.436921 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.436926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.437132 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.437777 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:12.437816 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:12.439628 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:12.441665 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:12.441670 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:12.441680 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:12.441930 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:12.442241 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:12.442243 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:12.442244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:12.442447 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:12.442845 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:12.442854 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:12.443155 (+ 301us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.443380 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.443734 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":121,"threads_started":1}
I20260807 18:44:12.445947 21943 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35253
I20260807 18:44:12.446180 21943 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:12.446631 21943 heartbeater.cc:511] Master 127.10.174.254:35253 requested a full tablet report, sending...
I20260807 18:44:12.447643 21605 ts_manager.cc:194] Registered new tserver with Master: e4d5fca34b124fee90088380ba970fac (127.10.174.194:36175)
I20260807 18:44:12.448186 21605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:58357
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:44:12.463770 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35253
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:12.572342 21948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:12.572616 21948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:12.572693 21948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:12.576824 21948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:12.576894 21948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:12.576978 21948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:44:12.582264 21948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:35253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:12.583310 21948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:12.584308 21948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:12.594086 21956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:12.594086 21953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:12.594110 21954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:12.594133 21948 server_base.cc:1034] running on GCE node
I20260807 18:44:12.594743 21948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:12.595422 21948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:12.596588 21948 hybrid_clock.cc:648] HybridClock initialized: now 1786128252596575 us; error 30 us; skew 500 ppm
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[21558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128252, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:12.599269 21948 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:44:12.600157 21948 webserver.cc:460] Webserver started at http://127.10.174.195:44059/ using document root <none> and password file <none>
I20260807 18:44:12.600688 21948 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:12.600747 21948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:12.600914 21948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:44:12.602901 21948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "500ea22c277848408a8bcd3c0b89ca4a"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "15904f26f553c0be4af50371370296df"
server_key_iv: "f4b67c944bdc34b35e2f48e247ad43bd"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.603483 21948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "500ea22c277848408a8bcd3c0b89ca4a"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "15904f26f553c0be4af50371370296df"
server_key_iv: "f4b67c944bdc34b35e2f48e247ad43bd"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.607151 21948 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:44:12.609536 21963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.610695 21948 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:44:12.610797 21948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "500ea22c277848408a8bcd3c0b89ca4a"
format_stamp: "Formatted at 2026-08-07 18:44:12 on dist-test-slave-07c2"
server_key: "15904f26f553c0be4af50371370296df"
server_key_iv: "f4b67c944bdc34b35e2f48e247ad43bd"
server_key_version: "encryptionkey@0"
I20260807 18:44:12.610884 21948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:12.637387 21948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:12.640789 21948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:12.640946 21948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:12.641484 21948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:12.642247 21948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:12.642294 21948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.642333 21948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:12.642354 21948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:12.651207 21948 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:40099
I20260807 18:44:12.651233 22079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:40099 every 8 connection(s)
I20260807 18:44:12.652137 21948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:44:12.659773 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 21948
I20260807 18:44:12.659915 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:44:12.660256 10939 external_mini_cluster.cc:1428] Setting key 3fba650cdf79ea9460df295b1d28bcf5
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[21558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128252, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:12.665738 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.653967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:47723 (local address 127.10.174.254:35253)
0807 18:44:12.654138 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.654143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.655010 (+ 867us) server_negotiation.cc:407] Connection header received
0807 18:44:12.656366 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.656368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.656414 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.656491 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:12.657597 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.658126 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.659185 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.659456 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.659533 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.662551 (+ 3018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:12.662555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:12.662557 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:12.662579 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:12.664033 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.664475 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.664478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.664479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.664554 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.664847 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.664849 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.664850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.665011 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:12.665088 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.665533 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.665624 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:44:12.666529 22082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.654399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:35253 (local address 127.10.174.195:47723)
0807 18:44:12.654865 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.654907 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.656180 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.656638 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.656645 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.657001 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:12.657460 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.657472 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.658229 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.658231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.659087 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.659096 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.659604 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.659608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.659819 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.660446 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:12.660466 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:12.662381 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:12.664135 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:12.664139 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:12.664150 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:12.664392 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:12.664647 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:12.664649 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:12.664650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:12.664775 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:12.665094 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:12.665131 (+ 37us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:12.665341 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.665490 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.665743 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":127,"threads_started":1}
I20260807 18:44:12.667618 22080 heartbeater.cc:347] Connected to a master server at 127.10.174.254:35253
I20260807 18:44:12.667855 22080 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:12.668304 22080 heartbeater.cc:511] Master 127.10.174.254:35253 requested a full tablet report, sending...
I20260807 18:44:12.669257 21605 ts_manager.cc:194] Registered new tserver with Master: 500ea22c277848408a8bcd3c0b89ca4a (127.10.174.195:40099)
I20260807 18:44:12.669764 21605 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:47723
I20260807 18:44:12.673884 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:44:12.683002 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.675799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44376 (local address 127.10.174.254:35253)
0807 18:44:12.675906 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.675909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.676095 (+ 186us) server_negotiation.cc:407] Connection header received
0807 18:44:12.676188 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.676190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.676222 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.676310 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:12.676983 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.677472 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.678341 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.678548 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.678623 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.679795 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:12.679798 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:12.679799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:12.679818 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:12.681206 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.681653 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.681655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.681656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.681738 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:12.682014 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:12.682020 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:12.682022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:12.682308 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:12.682436 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.682725 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.682850 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:44:12.685961 21605 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:44:12.688956 21605 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:44:12.703796 22092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.697202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36175 (local address 127.0.0.1:53568)
0807 18:44:12.697526 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.697579 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.697710 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.698602 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.698609 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.698636 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:12.698804 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.698815 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.700344 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.700351 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.702105 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.702117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.703219 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.703223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.703373 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.703400 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.703447 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.703611 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":235,"spinlock_wait_cycles":1664,"thread_start_us":78,"threads_started":1}
I20260807 18:44:12.703866 22094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.697979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:32919 (local address 127.0.0.1:52728)
0807 18:44:12.698217 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.698232 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.698321 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.698978 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.698981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.698999 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:12.699140 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.699148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.700740 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.700744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.702105 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.702117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.703413 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.703420 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.703526 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.703557 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.703648 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.703712 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":65,"thread_start_us":114,"threads_started":1}
I20260807 18:44:12.704072 22096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.698344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:40099 (local address 127.0.0.1:59972)
0807 18:44:12.698570 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.698584 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.698680 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.699882 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.699886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.699905 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:12.700004 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.700010 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.701169 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.701174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.702300 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.702310 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.703149 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.703153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.703275 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.703350 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.703463 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.703608 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":37,"spinlock_wait_cycles":896,"thread_start_us":101,"threads_started":1}
I20260807 18:44:12.704263 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.698122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52728 (local address 127.10.174.193:32919)
0807 18:44:12.698517 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.698532 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.698554 (+ 22us) server_negotiation.cc:407] Connection header received
0807 18:44:12.698636 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.698641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.698826 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.699324 (+ 498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:12.699482 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.700599 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.702460 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.703238 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.703418 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.703547 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.703687 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.703774 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":116,"threads_started":1}
I20260807 18:44:12.704341 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.698918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.10.174.195:40099)
0807 18:44:12.699435 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.699454 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.699474 (+ 20us) server_negotiation.cc:407] Connection header received
0807 18:44:12.699543 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.699548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.699734 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.699876 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:12.700127 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.701049 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.702430 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.703014 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.703160 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.703323 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.703770 (+ 447us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.704051 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":129,"threads_started":1}
I20260807 18:44:12.704980 22093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.697336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53568 (local address 127.10.174.194:36175)
0807 18:44:12.697954 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.697969 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.697995 (+ 26us) server_negotiation.cc:407] Connection header received
0807 18:44:12.698166 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.698173 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.698398 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.698979 (+ 581us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:12.699188 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.700217 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.702231 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.703072 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.704198 (+ 1126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.704335 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.704388 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.704493 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":121,"threads_started":1}
I20260807 18:44:12.706945 22013 tablet_service.cc:1467] Processing CreateTablet for tablet 199d8967414d46c0ba0e0488da6a45b2 (DEFAULT_TABLE table=test-table [id=988b4ddc83ff42d7a5d16da7afda53f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:44:12.707152 21737 tablet_service.cc:1467] Processing CreateTablet for tablet 199d8967414d46c0ba0e0488da6a45b2 (DEFAULT_TABLE table=test-table [id=988b4ddc83ff42d7a5d16da7afda53f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:44:12.707234 21876 tablet_service.cc:1467] Processing CreateTablet for tablet 199d8967414d46c0ba0e0488da6a45b2 (DEFAULT_TABLE table=test-table [id=988b4ddc83ff42d7a5d16da7afda53f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:44:12.707966 22013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 199d8967414d46c0ba0e0488da6a45b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:12.708169 21876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 199d8967414d46c0ba0e0488da6a45b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:12.708169 21737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 199d8967414d46c0ba0e0488da6a45b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:12.714371 22098 tablet_bootstrap.cc:492] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Bootstrap starting.
I20260807 18:44:12.715797 22100 tablet_bootstrap.cc:492] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae: Bootstrap starting.
I20260807 18:44:12.716590 22098 tablet_bootstrap.cc:654] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:12.717459 22100 tablet_bootstrap.cc:654] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:12.717692 22098 log.cc:824] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:12.718292 22099 tablet_bootstrap.cc:492] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Bootstrap starting.
I20260807 18:44:12.718268 22100 log.cc:824] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:12.719820 22098 tablet_bootstrap.cc:492] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: No bootstrap required, opened a new log
I20260807 18:44:12.720026 22098 ts_tablet_manager.cc:1397] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:44:12.720232 22100 tablet_bootstrap.cc:492] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae: No bootstrap required, opened a new log
I20260807 18:44:12.720413 22100 ts_tablet_manager.cc:1397] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:44:12.720901 22099 tablet_bootstrap.cc:654] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:12.721751 22099 log.cc:824] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:12.723320 22098 raft_consensus.cc:348] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.723564 22098 raft_consensus.cc:374] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:12.723626 22098 raft_consensus.cc:729] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 500ea22c277848408a8bcd3c0b89ca4a, State: Initialized, Role: FOLLOWER
I20260807 18:44:12.723748 22099 tablet_bootstrap.cc:492] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: No bootstrap required, opened a new log
I20260807 18:44:12.723919 22099 ts_tablet_manager.cc:1397] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:44:12.724121 22098 consensus_queue.cc:260] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.724561 22100 raft_consensus.cc:348] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.724728 22080 heartbeater.cc:503] Master 127.10.174.254:35253 was elected leader, sending a full tablet report...
I20260807 18:44:12.724802 22100 raft_consensus.cc:374] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:12.724852 22100 raft_consensus.cc:729] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b1410529714f33a11a9a31c98d37ae, State: Initialized, Role: FOLLOWER
I20260807 18:44:12.725075 22098 ts_tablet_manager.cc:1428] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:44:12.725293 22100 consensus_queue.cc:260] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.725991 21805 heartbeater.cc:503] Master 127.10.174.254:35253 was elected leader, sending a full tablet report...
I20260807 18:44:12.726241 22100 ts_tablet_manager.cc:1428] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:44:12.727620 22099 raft_consensus.cc:348] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.727874 22099 raft_consensus.cc:374] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:12.727933 22099 raft_consensus.cc:729] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d5fca34b124fee90088380ba970fac, State: Initialized, Role: FOLLOWER
I20260807 18:44:12.728343 22099 consensus_queue.cc:260] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.729338 22099 ts_tablet_manager.cc:1428] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:44:12.729640 21943 heartbeater.cc:503] Master 127.10.174.254:35253 was elected leader, sending a full tablet report...
I20260807 18:44:12.731446 22105 raft_consensus.cc:482] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:44:12.731642 22105 raft_consensus.cc:504] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.732501 22105 leader_election.cc:288] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4d5fca34b124fee90088380ba970fac (127.10.174.194:36175), 500ea22c277848408a8bcd3c0b89ca4a (127.10.174.195:40099)
I20260807 18:44:12.736263 22093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.732798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:32843 (local address 127.10.174.194:36175)
0807 18:44:12.732949 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.732954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.733106 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:44:12.733256 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.733260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.733306 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.733382 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:12.733665 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.734171 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.735203 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.735712 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.735842 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.735893 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.736083 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.736171 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:44:12.736531 22107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.732734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:36175 (local address 127.10.174.193:32843)
0807 18:44:12.733012 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.733024 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.733153 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.733394 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.733397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.733414 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:12.733560 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.733566 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.734278 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.734283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.735079 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.735089 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.735841 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.735844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.735944 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.735969 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.736050 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.736377 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":111,"threads_started":1}
I20260807 18:44:12.737013 22108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.733136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:40099 (local address 127.10.174.193:45367)
0807 18:44:12.733462 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.733473 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:12.733596 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:12.733834 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:12.733837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:12.733852 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:12.733974 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.733979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.734680 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.734685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.735507 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:12.735517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.736476 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.736479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:12.736580 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.736606 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 18:44:12.736790 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 18:44:12.736868 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":90,"threads_started":1}
I20260807 18:44:12.737003 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.733210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:45367 (local address 127.10.174.195:40099)
0807 18:44:12.733325 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.733332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.733546 (+ 214us) server_negotiation.cc:407] Connection header received
0807 18:44:12.733695 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.733698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.733745 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.733825 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:12.734085 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.734571 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.735665 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.736261 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.736376 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.736419 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.736811 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.736891 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:44:12.737118 21896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "199d8967414d46c0ba0e0488da6a45b2" candidate_uuid: "11b1410529714f33a11a9a31c98d37ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d5fca34b124fee90088380ba970fac" is_pre_election: true
I20260807 18:44:12.737383 21896 raft_consensus.cc:2454] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b1410529714f33a11a9a31c98d37ae in term 0.
I20260807 18:44:12.737663 22034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "199d8967414d46c0ba0e0488da6a45b2" candidate_uuid: "11b1410529714f33a11a9a31c98d37ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "500ea22c277848408a8bcd3c0b89ca4a" is_pre_election: true
I20260807 18:44:12.737864 21687 leader_election.cc:302] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b1410529714f33a11a9a31c98d37ae, e4d5fca34b124fee90088380ba970fac; no voters:
I20260807 18:44:12.737934 22034 raft_consensus.cc:2454] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b1410529714f33a11a9a31c98d37ae in term 0.
I20260807 18:44:12.738145 22105 raft_consensus.cc:2781] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:44:12.738225 22105 raft_consensus.cc:482] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:44:12.738292 22105 raft_consensus.cc:3037] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:12.739476 22105 raft_consensus.cc:504] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.739811 22105 leader_election.cc:288] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [CANDIDATE]: Term 1 election: Requested vote from peers e4d5fca34b124fee90088380ba970fac (127.10.174.194:36175), 500ea22c277848408a8bcd3c0b89ca4a (127.10.174.195:40099)
I20260807 18:44:12.740146 21896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "199d8967414d46c0ba0e0488da6a45b2" candidate_uuid: "11b1410529714f33a11a9a31c98d37ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d5fca34b124fee90088380ba970fac"
I20260807 18:44:12.740203 22034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "199d8967414d46c0ba0e0488da6a45b2" candidate_uuid: "11b1410529714f33a11a9a31c98d37ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "500ea22c277848408a8bcd3c0b89ca4a"
I20260807 18:44:12.740257 21896 raft_consensus.cc:3037] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:12.740337 22034 raft_consensus.cc:3037] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:12.741295 21896 raft_consensus.cc:2454] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b1410529714f33a11a9a31c98d37ae in term 1.
I20260807 18:44:12.741421 22034 raft_consensus.cc:2454] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b1410529714f33a11a9a31c98d37ae in term 1.
I20260807 18:44:12.741658 21687 leader_election.cc:302] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b1410529714f33a11a9a31c98d37ae, e4d5fca34b124fee90088380ba970fac; no voters:
I20260807 18:44:12.741861 22105 raft_consensus.cc:2781] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:44:12.742065 22105 raft_consensus.cc:686] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [term 1 LEADER]: Becoming Leader. State: Replica: 11b1410529714f33a11a9a31c98d37ae, State: Running, Role: LEADER
I20260807 18:44:12.742368 22105 consensus_queue.cc:237] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } }
I20260807 18:44:12.745286 21605 catalog_manager.cc:5495] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 11b1410529714f33a11a9a31c98d37ae (127.10.174.193). New cstate: current_term: 1 leader_uuid: "11b1410529714f33a11a9a31c98d37ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b1410529714f33a11a9a31c98d37ae" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 32919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 } health_report { overall_health: UNKNOWN } } }
I20260807 18:44:12.767053 22095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.763977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.10.174.193:32919)
0807 18:44:12.764113 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:12.764117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:12.764136 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:44:12.764254 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:12.764256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:12.764304 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:12.764383 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:44:12.764590 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.765079 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.765859 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:12.766058 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:12.766130 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:12.766375 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:44:12.766759 (+ 384us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:44:12.766845 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:12.766913 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 18:44:12.766955 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 18:44:12.772559 22034 raft_consensus.cc:1261] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 1 FOLLOWER]: Refusing update from remote peer 11b1410529714f33a11a9a31c98d37ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:44:12.772590 21896 raft_consensus.cc:1261] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 1 FOLLOWER]: Refusing update from remote peer 11b1410529714f33a11a9a31c98d37ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:44:12.773263 22105 consensus_queue.cc:1035] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "500ea22c277848408a8bcd3c0b89ca4a" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:44:12.773497 22109 consensus_queue.cc:1035] T 199d8967414d46c0ba0e0488da6a45b2 P 11b1410529714f33a11a9a31c98d37ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d5fca34b124fee90088380ba970fac" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 36175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:44:12.780503 22114 mvcc.cc:205] Tried to move back new op lower bound from 7315981323349544960 to 7315981323235217408. Current Snapshot: MvccSnapshot[applied={T|T < 7315981323349544960}]
I20260807 18:44:12.790094 21604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:44:12.790263 21604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:44:12.792585 21604 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40fe8f0ae212443199d844ac17718f69: Sending DeleteTablet for 3 replicas of tablet 199d8967414d46c0ba0e0488da6a45b2
I20260807 18:44:12.793263 21876 tablet_service.cc:1514] Processing DeleteTablet for tablet 199d8967414d46c0ba0e0488da6a45b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:44:12 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:53568
I20260807 18:44:12.793385 22013 tablet_service.cc:1514] Processing DeleteTablet for tablet 199d8967414d46c0ba0e0488da6a45b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:44:12 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:59972
I20260807 18:44:12.793437 21737 tablet_service.cc:1514] Processing DeleteTablet for tablet 199d8967414d46c0ba0e0488da6a45b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:44:12 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:52728
I20260807 18:44:12.793728 22122 tablet_replica.cc:330] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: stopping tablet replica
I20260807 18:44:12.794015 22122 raft_consensus.cc:2229] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:44:12.794309 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21670
I20260807 18:44:12.794317 22122 raft_consensus.cc:2258] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:44:12.794962 22124 tablet_replica.cc:330] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: stopping tablet replica
I20260807 18:44:12.795212 22124 raft_consensus.cc:2229] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:44:12.795457 22124 raft_consensus.cc:2258] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:44:12.797012 22124 ts_tablet_manager.cc:1905] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:44:12.798724 22122 ts_tablet_manager.cc:1905] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:44:12.800467 22124 ts_tablet_manager.cc:1918] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:44:12.800573 22124 log.cc:1196] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/199d8967414d46c0ba0e0488da6a45b2
I20260807 18:44:12.800933 22124 ts_tablet_manager.cc:1939] T 199d8967414d46c0ba0e0488da6a45b2 P 500ea22c277848408a8bcd3c0b89ca4a: Deleting consensus metadata
I20260807 18:44:12.800951 22122 ts_tablet_manager.cc:1918] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:44:12.801052 22122 log.cc:1196] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/199d8967414d46c0ba0e0488da6a45b2
I20260807 18:44:12.801333 22122 ts_tablet_manager.cc:1939] T 199d8967414d46c0ba0e0488da6a45b2 P e4d5fca34b124fee90088380ba970fac: Deleting consensus metadata
I20260807 18:44:12.802148 21590 catalog_manager.cc:4841] TS 500ea22c277848408a8bcd3c0b89ca4a (127.10.174.195:40099): tablet 199d8967414d46c0ba0e0488da6a45b2 (table test-table [id=988b4ddc83ff42d7a5d16da7afda53f4]) successfully deleted
I20260807 18:44:12.802343 21590 catalog_manager.cc:4841] TS e4d5fca34b124fee90088380ba970fac (127.10.174.194:36175): tablet 199d8967414d46c0ba0e0488da6a45b2 (table test-table [id=988b4ddc83ff42d7a5d16da7afda53f4]) successfully deleted
W20260807 18:44:12.804018 21590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:32919 (error 108)
I20260807 18:44:12.804129 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21810
I20260807 18:44:12.806430 22096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:12.806101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:32919 (local address 127.0.0.1:52732)
0807 18:44:12.806261 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:12.806337 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 18:44:12.806965 21590 catalog_manager.cc:4584] TS 11b1410529714f33a11a9a31c98d37ae (127.10.174.193:32919): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 199d8967414d46c0ba0e0488da6a45b2: Network error: Client connection negotiation failed: client connection to 127.10.174.193:32919: connect: Connection refused (error 111)
I20260807 18:44:12.811520 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21948
I20260807 18:44:12.817582 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 21572
2026-08-07T18:44:12Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2259 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[22128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[22128](info): set up 2 sockets
Aug 07 18:44:12 dist-test-slave-07c2 krb5kdc[22128](info): commencing operation
krb5kdc: starting...
W20260807 18:44:13.890882 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:44:13 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:44:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:44:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/rangeradmin_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/rangeradmin_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/rangerlookup_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/rangerlookup_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
I20260807 18:44:14.053944 10939 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskoRpd7b/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/postgres -l logfile start
2026-08-07 18:44:16.356 UTC [22159] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 18:44:16.356 UTC [22159] LOG: listening on IPv4 address "127.10.174.212", port 46839
2026-08-07 18:44:16.359 UTC [22159] LOG: listening on Unix socket "/tmp/.s.PGSQL.46839"
2026-08-07 18:44:16.393 UTC [22162] LOG: database system was shut down at 2026-08-07 18:44:15 UTC
2026-08-07 18:44:16.397 UTC [22159] LOG: database system is ready to accept connections
I20260807 18:44:17.371140 10939 mini_postgres.cc:96] Postgres bound to 46839
2026-08-07 18:44:17.382 UTC [22171] FATAL: database "slave" does not exist
127.10.174.212:46839 - accepting connections
I20260807 18:44:17.382855 10939 mini_ranger.cc:161] Starting Ranger...
I20260807 18:44:17.399602 10939 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 18:44:17.800387 10939 mini_ranger.cc:87] Created ranger Postgres database
I20260807 18:44:17.800482 10939 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-admin
2026-08-07 18:44:18,105 [I] DB FLAVOR :POSTGRES
2026-08-07 18:44:18,105 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 18:44:18,105 [I] Checking connection..
2026-08-07 18:44:18,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 18:44:18,370 [I] Checking connection passed.
2026-08-07 18:44:18,371 [I] --------- Verifying version history table ---------
2026-08-07 18:44:18,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 18:44:18,627 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 18:44:18,627 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 18:44:18,884 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 18:44:18,884 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 18:44:18,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 18:44:19.139 UTC [22235] WARNING: there is no transaction in progress
2026-08-07 18:44:19,145 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 18:44:19,146 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 18:44:19,404 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 18:44:19,405 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 18:44:19,405 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 18:44:19,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 18:44:19,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-07c2.c.gcp-upstream.internal','N') ;"
2026-08-07 18:44:20,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 18:44:20,373 [I] Table x_portal_user does not exist in database ranger
2026-08-07 18:44:20,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 18:44:20,630 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 18:44:20,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 18:44:20,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 18:44:21,148 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 18:44:21,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 18:44:22.064 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.080 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.095 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.109 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.125 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.142 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.192 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.198 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.211 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.221 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.230 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.243 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.251 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.257 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.263 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22.269 UTC [22348] WARNING: there is no transaction in progress
2026-08-07 18:44:22,835 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 18:44:22,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 18:44:23,079 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 18:44:23,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 18:44:23,311 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 18:44:23,312 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 18:44:23,573 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 18:44:23,573 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 18:44:23,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 18:44:24,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-07c2.c.gcp-upstream.internal';"
2026-08-07 18:44:24,344 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 18:44:24,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 18:44:24,584 [I] DB_PATCHES have already been applied
I20260807 18:44:24.590641 10939 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-admin:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskoRpd7b/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 18:44:24.590705 10939 mini_ranger.cc:193] Using host: 127.10.174.212
I20260807 18:44:24.594815 10939 mini_ranger.cc:227] Ranger admin URL: http://127.10.174.212:41881
Aug 07, 2026 6:44:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:44:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:44:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 18:44:25.720440 10939 mini_ranger.cc:160] Time spent starting Ranger: real 8.338s user 0.000s sys 0.012s
Aug 07, 2026 6:44:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:44:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 6:44:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:44:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:44:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 18:44:48.109331 10939 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/rangerkms_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/rangerkms_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.174.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.174.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 18:44:48 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128288, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 18:44:48.213742 10939 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 18:44:48.224658 10939 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 18:44:48.933473 10939 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 18:44:48.933558 10939 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms
I20260807 18:44:48.933655 10939 mini_ranger_kms.cc:227] Using postgres at 127.10.174.212:46839
2026-08-07 18:44:49,277 [I] DB FLAVOR :POSTGRES
2026-08-07 18:44:49,277 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 18:44:49,277 [I] Checking connection
2026-08-07 18:44:49,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 18:44:49,532 [I] connection success
2026-08-07 18:44:49,532 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 18:44:49,532 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 18:44:49,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 18:44:49,793 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 18:44:49,793 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 18:44:49,794 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 18:44:49,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:46839/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 18:44:50,041 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 18:44:50.530694 10939 mini_ranger_kms.cc:310] Created kms service
I20260807 18:44:50.720412 10939 mini_ranger_kms.cc:326] Created kudu user
I20260807 18:44:50.762719 10939 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 18:44:50 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128288, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:51.184440 10939 mini_ranger_kms.cc:384] Added ranger policy
I20260807 18:44:51.184595 10939 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms:/tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 18:44:51.184619 10939 mini_ranger_kms.cc:240] Using host: 127.10.174.212
I20260807 18:44:51.189532 10939 mini_ranger_kms.cc:276] Ranger KMS PID: 22534
I20260807 18:44:51.189651 10939 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.174.212:33377
Aug 07, 2026 6:44:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:44:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:44:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:44:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:44:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:44:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 18:44:53.480934 10939 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.267s user 0.011s sys 0.314s
I20260807 18:44:53.481078 10939 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 18:44:53.481180 10939 mini_ranger_kms.cc:401] 127.10.174.212:33377/kms/v1/keys
Aug 07 18:44:53 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786128293, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.174.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 18:44:54 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128293, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.174.212@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
Aug 07 18:44:54 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128293, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.174.212@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
Aug 07 18:44:57 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:44:57.078035 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42187
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:42187
--ranger_config_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:33377/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:57.204700 22585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:57.205003 22585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:57.205084 22585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:57.209209 22585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:44:57.209306 22585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:57.209344 22585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:57.209401 22585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:44:57.209439 22585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:44:57.215090 22585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.174.212:33377/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:42187
--ranger_config_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:57.216529 22585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:57.217617 22585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:44:57.228046 22585 server_base.cc:1034] running on GCE node
W20260807 18:44:57.228144 22590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:57.228034 22591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:57.228055 22593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:57.228912 22585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:57.230038 22585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:57.231231 22585 hybrid_clock.cc:648] HybridClock initialized: now 1786128297231214 us; error 35 us; skew 500 ppm
Aug 07 18:44:57 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128297, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:57.238418 22585 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:44:57.239553 22585 webserver.cc:460] Webserver started at http://127.10.174.254:35003/ using document root <none> and password file <none>
I20260807 18:44:57.240139 22585 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:57.240221 22585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:57.240442 22585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:44:57 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128297, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:57.289316 22585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "dba521105d6040928d0c4f6e419d94c1"
format_stamp: "Formatted at 2026-08-07 18:44:57 on dist-test-slave-07c2"
server_key: "41a488b55f79468babc6310057a4b2f0"
server_key_iv: "9095fdbc71743f79c292bb7fe8bb2ef9"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:57.289995 22585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "dba521105d6040928d0c4f6e419d94c1"
format_stamp: "Formatted at 2026-08-07 18:44:57 on dist-test-slave-07c2"
server_key: "41a488b55f79468babc6310057a4b2f0"
server_key_iv: "9095fdbc71743f79c292bb7fe8bb2ef9"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:57.294068 22585 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:44:57.307823 22601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:57.309244 22585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:44:57.309355 22585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "dba521105d6040928d0c4f6e419d94c1"
format_stamp: "Formatted at 2026-08-07 18:44:57 on dist-test-slave-07c2"
server_key: "41a488b55f79468babc6310057a4b2f0"
server_key_iv: "9095fdbc71743f79c292bb7fe8bb2ef9"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:57.309516 22585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:57.324247 22585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:57.327056 22585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:57.327265 22585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:57.337373 22585 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:42187
I20260807 18:44:57.337431 22656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:42187 every 8 connection(s)
I20260807 18:44:57.338362 22585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:44:57.341671 22657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:57.346724 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 22585
I20260807 18:44:57.346886 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:44:57.347169 10939 external_mini_cluster.cc:1428] Setting key 6b8ea29f75536ca181ec1b2a7d8e98da
I20260807 18:44:57.348712 22657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1: Bootstrap starting.
I20260807 18:44:57.351454 22657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:57.352464 22657 log.cc:824] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:57.354676 22657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1: No bootstrap required, opened a new log
Aug 07 18:44:57 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:57.359376 22657 raft_consensus.cc:348] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba521105d6040928d0c4f6e419d94c1" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42187 } }
I20260807 18:44:57.359637 22657 raft_consensus.cc:374] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:57.359711 22657 raft_consensus.cc:729] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba521105d6040928d0c4f6e419d94c1, State: Initialized, Role: FOLLOWER
I20260807 18:44:57.360248 22657 consensus_queue.cc:260] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba521105d6040928d0c4f6e419d94c1" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42187 } }
I20260807 18:44:57.360409 22657 raft_consensus.cc:388] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:44:57.360478 22657 raft_consensus.cc:482] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:44:57.360586 22657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:57.361665 22657 raft_consensus.cc:504] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba521105d6040928d0c4f6e419d94c1" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42187 } }
I20260807 18:44:57.361999 22657 leader_election.cc:302] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dba521105d6040928d0c4f6e419d94c1; no voters:
I20260807 18:44:57.362325 22657 leader_election.cc:288] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:44:57.362473 22662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:44:57.362473 22660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:57.348706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33216 (local address 127.10.174.254:42187)
0807 18:44:57.349244 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:57.349269 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:57.349314 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:44:57.349997 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:57.350013 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:57.350340 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:57.350674 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:57.351516 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:57.352631 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:57.353747 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:57.354219 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:57.354387 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:57.357126 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:57.357132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:57.357145 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:57.357171 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:57.358801 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:57.359268 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:57.359273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:57.359278 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:57.359434 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:57.359770 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:57.359773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:57.359775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:57.360309 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:57.360545 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:57.361368 (+ 823us) server_negotiation.cc:299] Negotiation successful
0807 18:44:57.361591 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":138,"threads_started":1}
I20260807 18:44:57.363102 22662 raft_consensus.cc:686] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [term 1 LEADER]: Becoming Leader. State: Replica: dba521105d6040928d0c4f6e419d94c1, State: Running, Role: LEADER
I20260807 18:44:57.363441 22662 consensus_queue.cc:237] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba521105d6040928d0c4f6e419d94c1" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42187 } }
I20260807 18:44:57.363610 22657 sys_catalog.cc:564] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:44:57.364581 22662 sys_catalog.cc:455] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dba521105d6040928d0c4f6e419d94c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba521105d6040928d0c4f6e419d94c1" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42187 } } }
I20260807 18:44:57.364715 22662 sys_catalog.cc:458] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:57.364933 22662 sys_catalog.cc:455] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dba521105d6040928d0c4f6e419d94c1. Latest consensus state: current_term: 1 leader_uuid: "dba521105d6040928d0c4f6e419d94c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba521105d6040928d0c4f6e419d94c1" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42187 } } }
I20260807 18:44:57.365036 22662 sys_catalog.cc:458] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1 [sys.catalog]: This master's current role is: LEADER
I20260807 18:44:57.365685 22671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:44:57.365922 22657 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 18:44:57.376914 22671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:44:57.385345 22671 catalog_manager.cc:1347] Generated new cluster ID: 81bf7545b4114be5bda385f9205cdc37
I20260807 18:44:57.385419 22671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:44:57.426302 22671 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:44:57.427831 22671 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:44:57.435896 22671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1: Generated new TSK 0
I20260807 18:44:57.436890 22671 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:44:58.156810 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:33377/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42187
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:58.279835 22704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:58.280121 22704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:58.280248 22704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:58.285035 22704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:58.285120 22704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:58.285203 22704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:44:58.290547 22704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.174.212:33377/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:58.291771 22704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:58.292995 22704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:58.303736 22709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:58.303752 22710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:58.303762 22712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:58.303989 22704 server_base.cc:1034] running on GCE node
I20260807 18:44:58.304498 22704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:58.305130 22704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:58.306306 22704 hybrid_clock.cc:648] HybridClock initialized: now 1786128298306288 us; error 34 us; skew 500 ppm
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:58.309312 22704 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:44:58.310309 22704 webserver.cc:460] Webserver started at http://127.10.174.193:40787/ using document root <none> and password file <none>
I20260807 18:44:58.311010 22704 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:58.311120 22704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:58.311384 22704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:58.332329 22704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081"
format_stamp: "Formatted at 2026-08-07 18:44:58 on dist-test-slave-07c2"
server_key: "658d279fb20eba1b01e19e3799203e43"
server_key_iv: "1e45abe29c22d4eb1d40838516ba7a02"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:58.332985 22704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081"
format_stamp: "Formatted at 2026-08-07 18:44:58 on dist-test-slave-07c2"
server_key: "658d279fb20eba1b01e19e3799203e43"
server_key_iv: "1e45abe29c22d4eb1d40838516ba7a02"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:58.338652 22704 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 18:44:58.359728 22721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:58.361301 22704 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260807 18:44:58.361423 22704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081"
format_stamp: "Formatted at 2026-08-07 18:44:58 on dist-test-slave-07c2"
server_key: "658d279fb20eba1b01e19e3799203e43"
server_key_iv: "1e45abe29c22d4eb1d40838516ba7a02"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:58.361532 22704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:58.385339 22704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:58.388386 22704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:58.388594 22704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:58.389169 22704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:58.390074 22704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:58.390144 22704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:58.390235 22704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:58.390303 22704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:58.403604 22704 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:36525
I20260807 18:44:58.404762 22704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:44:58.408738 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 22704
I20260807 18:44:58.408880 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:44:58.409229 10939 external_mini_cluster.cc:1428] Setting key 4fa70db5982490312bcbb41db30a1469
I20260807 18:44:58.410131 22838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:36525 every 8 connection(s)
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:44:58.452334 22841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:58.411420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:42041 (local address 127.10.174.254:42187)
0807 18:44:58.419462 (+ 8042us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:58.419472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:58.424982 (+ 5510us) server_negotiation.cc:407] Connection header received
0807 18:44:58.426227 (+ 1245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:58.426231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:58.426287 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:58.426350 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:58.429482 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.430353 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.436231 (+ 5878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.436597 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.436676 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:58.445295 (+ 8619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:58.445299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:58.445303 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:58.445332 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:58.447197 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:58.447868 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:58.447872 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:58.447874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:58.447962 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:58.448364 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:58.448368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:58.448369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:58.448630 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:58.448723 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:58.452002 (+ 3279us) server_negotiation.cc:299] Negotiation successful
0807 18:44:58.452148 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7953,"thread_start_us":114,"threads_started":1}
I20260807 18:44:58.453845 22842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:58.411439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42187 (local address 127.10.174.193:42041)
0807 18:44:58.424814 (+ 13375us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:58.424875 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:58.425968 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:58.426755 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:58.426764 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:58.427139 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:58.427917 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:58.427936 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.430520 (+ 2584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.430523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:58.431850 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:58.431861 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.436893 (+ 5032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.436896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:58.437107 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:58.441742 (+ 4635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:58.441783 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:58.445060 (+ 3277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:58.447370 (+ 2310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:58.447377 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:58.447395 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:58.447743 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:58.448063 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:58.448066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:58.448068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:58.448254 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:58.448779 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:58.448785 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:58.449120 (+ 335us) client_negotiation.cc:769] Sending connection context
0807 18:44:58.449325 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 18:44:58.449692 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13106,"thread_start_us":116,"threads_started":1}
I20260807 18:44:58.455557 22839 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42187
I20260807 18:44:58.455790 22839 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:58.456328 22839 heartbeater.cc:511] Master 127.10.174.254:42187 requested a full tablet report, sending...
I20260807 18:44:58.458003 22619 ts_manager.cc:194] Registered new tserver with Master: 5e9df4c80e9b4f01b2c4436c9f8d7081 (127.10.174.193:36525)
I20260807 18:44:58.459501 22619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:42041
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:44:58.489612 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:33377/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42187
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 18:44:58.656057 22847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:58.656502 22847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:58.656620 22847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:58.662639 22847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:58.662786 22847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:58.662922 22847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:44:58.671276 22847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.174.212:33377/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:58.672812 22847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:58.674142 22847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:44:58.687027 22854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:58.687178 22856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:58.687201 22847 server_base.cc:1034] running on GCE node
W20260807 18:44:58.687647 22853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:58.688217 22847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:58.688951 22847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:58.690129 22847 hybrid_clock.cc:648] HybridClock initialized: now 1786128298690102 us; error 45 us; skew 500 ppm
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:58.693074 22847 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:44:58.694180 22847 webserver.cc:460] Webserver started at http://127.10.174.194:45433/ using document root <none> and password file <none>
I20260807 18:44:58.694944 22847 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:58.695066 22847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:58.695379 22847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:58.716144 22847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "552d81d9d2c54b8ca68884db33fd6f3d"
format_stamp: "Formatted at 2026-08-07 18:44:58 on dist-test-slave-07c2"
server_key: "ebd5fdeaa661f41f2ea0cf3a9d91532f"
server_key_iv: "caf402daa92dcc9fdc7e4c79c9a40ba4"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:58.719859 22847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "552d81d9d2c54b8ca68884db33fd6f3d"
format_stamp: "Formatted at 2026-08-07 18:44:58 on dist-test-slave-07c2"
server_key: "ebd5fdeaa661f41f2ea0cf3a9d91532f"
server_key_iv: "caf402daa92dcc9fdc7e4c79c9a40ba4"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:58.730363 22847 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.000s
I20260807 18:44:58.752839 22863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:58.754629 22847 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260807 18:44:58.754771 22847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "552d81d9d2c54b8ca68884db33fd6f3d"
format_stamp: "Formatted at 2026-08-07 18:44:58 on dist-test-slave-07c2"
server_key: "ebd5fdeaa661f41f2ea0cf3a9d91532f"
server_key_iv: "caf402daa92dcc9fdc7e4c79c9a40ba4"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:58.754917 22847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:58.778620 22847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:58.782579 22847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:58.782861 22847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:58.783793 22847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:58.784958 22847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:58.785086 22847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:58.785204 22847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:58.785279 22847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:58.802107 22847 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:40735
I20260807 18:44:58.803427 22847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:44:58.805552 22980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:40735 every 8 connection(s)
I20260807 18:44:58.813283 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 22847
I20260807 18:44:58.813444 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:44:58.813798 10939 external_mini_cluster.cc:1428] Setting key c1ffd7c08c4bde35048ae510b7bb7905
Aug 07 18:44:58 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:58.824584 22841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:58.809230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:42017 (local address 127.10.174.254:42187)
0807 18:44:58.809365 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:58.809370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:58.810169 (+ 799us) server_negotiation.cc:407] Connection header received
0807 18:44:58.811560 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:58.811564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:58.811622 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:58.811684 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:58.813548 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.814305 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.816002 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.816404 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.816514 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:58.819888 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:58.819892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:58.819895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:58.819923 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:58.821833 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:58.822509 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:58.822513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:58.822515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:58.822611 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:58.823135 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:58.823139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:58.823140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:58.823427 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:58.823519 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:58.824267 (+ 748us) server_negotiation.cc:299] Negotiation successful
0807 18:44:58.824412 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:44:58.826624 22983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:58.808017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42187 (local address 127.10.174.194:42017)
0807 18:44:58.809976 (+ 1959us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:58.810034 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:58.811278 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:58.812124 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:58.812135 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:58.812527 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:58.813225 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:58.813248 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.814528 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.814531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:58.815857 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:58.815871 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:58.816730 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:58.816736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:58.816964 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:58.817807 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:58.817833 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:58.819682 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:58.821989 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:58.821994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:58.822010 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:58.822381 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:58.822778 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:58.822781 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:58.822783 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:58.822986 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:58.823596 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:58.823603 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:58.823950 (+ 347us) client_negotiation.cc:769] Sending connection context
0807 18:44:58.825128 (+ 1178us) client_negotiation.cc:240] Negotiation successful
0807 18:44:58.825477 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1733,"thread_start_us":171,"threads_started":1}
I20260807 18:44:58.828312 22981 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42187
I20260807 18:44:58.828655 22981 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:58.829268 22981 heartbeater.cc:511] Master 127.10.174.254:42187 requested a full tablet report, sending...
I20260807 18:44:58.830470 22619 ts_manager.cc:194] Registered new tserver with Master: 552d81d9d2c54b8ca68884db33fd6f3d (127.10.174.194:40735)
I20260807 18:44:58.831238 22619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:42017
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:44:58.870810 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:33377/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42187
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:39367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:44:59.051587 22986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:44:59.052016 22986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:44:59.052138 22986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:44:59.058182 22986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:44:59.058328 22986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:44:59.058456 22986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:44:59.067144 22986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:39367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.174.212:33377/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:44:59.068857 22986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:44:59.070297 22986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:44:59.085268 22986 server_base.cc:1034] running on GCE node
W20260807 18:44:59.085132 22991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:59.085130 22994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:44:59.087441 22992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:44:59.088089 22986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:44:59.088881 22986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:44:59.092131 22986 hybrid_clock.cc:648] HybridClock initialized: now 1786128299092049 us; error 85 us; skew 500 ppm
Aug 07 18:44:59 dist-test-slave-07c2 krb5kdc[22128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128299, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:44:59.096161 22986 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:44:59.097285 22986 webserver.cc:460] Webserver started at http://127.10.174.195:37947/ using document root <none> and password file <none>
I20260807 18:44:59.098091 22986 fs_manager.cc:359] Metadata directory not provided
I20260807 18:44:59.098245 22986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:44:59.098538 22986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:44:59 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128299, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:59.122663 22986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "7699b57631044b9b97c48cca73bbdd14"
format_stamp: "Formatted at 2026-08-07 18:44:59 on dist-test-slave-07c2"
server_key: "f597a327d3a4697527d53780167f7bfd"
server_key_iv: "15a71f24909980cbcb13d7b3cdcbb22a"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:59.123881 22986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "7699b57631044b9b97c48cca73bbdd14"
format_stamp: "Formatted at 2026-08-07 18:44:59 on dist-test-slave-07c2"
server_key: "f597a327d3a4697527d53780167f7bfd"
server_key_iv: "15a71f24909980cbcb13d7b3cdcbb22a"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:59.129334 22986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
Aug 07 18:44:59 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:59.150301 23001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:59.151921 22986 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 18:44:59.152045 22986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "7699b57631044b9b97c48cca73bbdd14"
format_stamp: "Formatted at 2026-08-07 18:44:59 on dist-test-slave-07c2"
server_key: "f597a327d3a4697527d53780167f7bfd"
server_key_iv: "15a71f24909980cbcb13d7b3cdcbb22a"
server_key_version: "kuduclusterkey@0"
I20260807 18:44:59.152169 22986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:44:59.185454 22986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:44:59.196367 22986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:44:59.196650 22986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:44:59.197453 22986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:44:59.198511 22986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:44:59.198642 22986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:59.198738 22986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:44:59.198801 22986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:44:59.212262 22986 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39003
I20260807 18:44:59.213394 22986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:44:59.214319 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 22986
I20260807 18:44:59.214465 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:44:59.214797 10939 external_mini_cluster.cc:1428] Setting key dfbd890df98e435f0dff1daa3c5551d7
I20260807 18:44:59.226509 23117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39003 every 8 connection(s)
Aug 07 18:44:59 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128299, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:44:59.254789 22841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.228466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:42677 (local address 127.10.174.254:42187)
0807 18:44:59.228622 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.228627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.239264 (+ 10637us) server_negotiation.cc:407] Connection header received
0807 18:44:59.240721 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.240725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.240777 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.240825 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:59.242639 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.243449 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.246397 (+ 2948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.246745 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.246826 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.250224 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:59.250228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:59.250231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:59.250258 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:59.252120 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:59.252970 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:59.252973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:59.252975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:59.253068 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:59.253483 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:59.253487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:59.253488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:59.253720 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:59.253796 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.254474 (+ 678us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.254618 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 18:44:59.258360 23120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.229020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42187 (local address 127.10.174.195:42677)
0807 18:44:59.239093 (+ 10073us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.239163 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:59.240465 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:59.241226 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:59.241235 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:59.241698 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:44:59.242461 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.242480 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.244947 (+ 2467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.244950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.246256 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.246267 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.247036 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.247039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.247241 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.248088 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:44:59.248109 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:44:59.250028 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:44:59.252460 (+ 2432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:59.252465 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:59.252482 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:59.252846 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:59.253185 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:44:59.253188 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:44:59.253190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:44:59.253369 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:44:59.253881 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:44:59.253887 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:44:59.254197 (+ 310us) client_negotiation.cc:769] Sending connection context
0807 18:44:59.256735 (+ 2538us) client_negotiation.cc:240] Negotiation successful
0807 18:44:59.257201 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9808,"thread_start_us":146,"threads_started":1}
I20260807 18:44:59.259990 23118 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42187
I20260807 18:44:59.260224 23118 heartbeater.cc:464] Registering TS with master...
I20260807 18:44:59.260807 23118 heartbeater.cc:511] Master 127.10.174.254:42187 requested a full tablet report, sending...
I20260807 18:44:59.261978 22619 ts_manager.cc:194] Registered new tserver with Master: 7699b57631044b9b97c48cca73bbdd14 (127.10.174.195:39003)
I20260807 18:44:59.262701 22619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:42677
I20260807 18:44:59.268239 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:44:59.281486 22841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.271073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52082 (local address 127.10.174.254:42187)
0807 18:44:59.271185 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.271189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.271922 (+ 733us) server_negotiation.cc:407] Connection header received
0807 18:44:59.272109 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.272112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.272159 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.272208 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:44:59.273301 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.274099 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.275346 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.275701 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.275780 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.277662 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:44:59.277667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:44:59.277672 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:44:59.277703 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:44:59.279462 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:59.279965 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:59.279968 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:59.279971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:59.280074 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:44:59.280427 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:44:59.280431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:44:59.280433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:44:59.280711 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:44:59.280820 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.281203 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.281322 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:44:59.285424 22619 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:44:59.290114 22619 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:44:59.323652 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.307154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46538 (local address 127.10.174.194:40735)
0807 18:44:59.309783 (+ 2629us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.309800 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.311112 (+ 1312us) server_negotiation.cc:407] Connection header received
0807 18:44:59.311737 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.311743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.311955 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.312141 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:59.312687 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.314684 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.320872 (+ 6188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.322566 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.322669 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.322797 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.323368 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.323477 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2517,"thread_start_us":81,"threads_started":1}
I20260807 18:44:59.324369 23133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.306197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:40735 (local address 127.0.0.1:46538)
0807 18:44:59.310961 (+ 4764us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.311014 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:59.311578 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:59.312382 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:59.312385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:59.312403 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:59.312516 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.312522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.314834 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.314838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.320644 (+ 5806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.320653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.322900 (+ 2247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.322903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.323038 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.323088 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 18:44:59.323198 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 18:44:59.324231 (+ 1033us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4590,"thread_start_us":145,"threads_started":1}
I20260807 18:44:59.325955 23136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.309394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46320 (local address 127.10.174.195:39003)
0807 18:44:59.310014 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.310719 (+ 705us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.311662 (+ 943us) server_negotiation.cc:407] Connection header received
0807 18:44:59.311745 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.311750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.311947 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.312099 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:59.312546 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.313811 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.315543 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.316382 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.316501 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.316628 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.325711 (+ 9083us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.325822 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":181,"threads_started":1}
I20260807 18:44:59.329645 22912 tablet_service.cc:1467] Processing CreateTablet for tablet df15c5e661a847058434300eaf075fd8 (DEFAULT_TABLE table=test-table [id=f7cde2b6bb4c41eda4d1aeda0a68eda9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:44:59.330788 22912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df15c5e661a847058434300eaf075fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:59.325610 23131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.309198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39003 (local address 127.0.0.1:46320)
0807 18:44:59.311444 (+ 2246us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.311459 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:59.311566 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:59.312264 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:59.312271 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:59.312292 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:59.312415 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.312421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.313945 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.313949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.315265 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.315276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.325221 (+ 9945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.325224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.325324 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.325348 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:44:59.325427 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 18:44:59.325496 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2175,"thread_start_us":143,"threads_started":1}
I20260807 18:44:59.342556 23050 tablet_service.cc:1467] Processing CreateTablet for tablet df15c5e661a847058434300eaf075fd8 (DEFAULT_TABLE table=test-table [id=f7cde2b6bb4c41eda4d1aeda0a68eda9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:44:59.343165 23137 tablet_bootstrap.cc:492] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Bootstrap starting.
I20260807 18:44:59.343778 23050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df15c5e661a847058434300eaf075fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:59.345474 23137 tablet_bootstrap.cc:654] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:59.352941 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.308555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36525 (local address 127.0.0.1:52062)
0807 18:44:59.311256 (+ 2701us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.311270 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:59.311425 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:59.316132 (+ 4707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:59.316135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:59.316153 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:59.316236 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.316243 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.319047 (+ 2804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.319050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.320277 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.320289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.352477 (+ 32188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.352482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.352616 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.352649 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 18:44:59.352706 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 18:44:59.352792 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2639,"thread_start_us":87,"threads_started":1}
I20260807 18:44:59.353605 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.308727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52062 (local address 127.10.174.193:36525)
0807 18:44:59.315485 (+ 6758us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.315492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.315515 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:44:59.315590 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.315596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.315797 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.315966 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:59.317755 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.318909 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.324636 (+ 5727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.352280 (+ 27644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.353166 (+ 886us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.353311 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.353366 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.353460 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6651,"thread_start_us":90,"threads_started":1}
I20260807 18:44:59.355506 23138 tablet_bootstrap.cc:492] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Bootstrap starting.
I20260807 18:44:59.356580 22770 tablet_service.cc:1467] Processing CreateTablet for tablet df15c5e661a847058434300eaf075fd8 (DEFAULT_TABLE table=test-table [id=f7cde2b6bb4c41eda4d1aeda0a68eda9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:44:59.357636 22770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df15c5e661a847058434300eaf075fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:44:59.359025 23138 tablet_bootstrap.cc:654] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:59.359894 23138 log.cc:824] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:59.362151 23138 tablet_bootstrap.cc:492] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: No bootstrap required, opened a new log
I20260807 18:44:59.362351 23138 ts_tablet_manager.cc:1397] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 18:44:59.354385 23137 log.cc:824] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:59.366933 23138 raft_consensus.cc:348] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.367383 23138 raft_consensus.cc:374] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:59.367502 23138 raft_consensus.cc:729] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7699b57631044b9b97c48cca73bbdd14, State: Initialized, Role: FOLLOWER
I20260807 18:44:59.368078 23138 consensus_queue.cc:260] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.369211 23138 ts_tablet_manager.cc:1428] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 18:44:59.369627 23118 heartbeater.cc:503] Master 127.10.174.254:42187 was elected leader, sending a full tablet report...
I20260807 18:44:59.369824 23137 tablet_bootstrap.cc:492] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: No bootstrap required, opened a new log
I20260807 18:44:59.370044 23137 ts_tablet_manager.cc:1397] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260807 18:44:59.370133 23141 tablet_bootstrap.cc:492] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: Bootstrap starting.
I20260807 18:44:59.372816 23141 tablet_bootstrap.cc:654] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: Neither blocks nor log segments found. Creating new log.
I20260807 18:44:59.373816 23141 log.cc:824] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: Log is configured to *not* fsync() on all Append() calls
I20260807 18:44:59.375954 23141 tablet_bootstrap.cc:492] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: No bootstrap required, opened a new log
I20260807 18:44:59.376130 23141 ts_tablet_manager.cc:1397] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.006s
I20260807 18:44:59.378444 23137 raft_consensus.cc:348] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.378758 23137 raft_consensus.cc:374] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:59.378813 23137 raft_consensus.cc:729] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 552d81d9d2c54b8ca68884db33fd6f3d, State: Initialized, Role: FOLLOWER
I20260807 18:44:59.379346 23137 consensus_queue.cc:260] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.380471 23137 ts_tablet_manager.cc:1428] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 18:44:59.380475 23141 raft_consensus.cc:348] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.380694 23141 raft_consensus.cc:374] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:44:59.380759 23141 raft_consensus.cc:729] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9df4c80e9b4f01b2c4436c9f8d7081, State: Initialized, Role: FOLLOWER
I20260807 18:44:59.380829 22981 heartbeater.cc:503] Master 127.10.174.254:42187 was elected leader, sending a full tablet report...
I20260807 18:44:59.381417 23141 consensus_queue.cc:260] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.382462 23141 ts_tablet_manager.cc:1428] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260807 18:44:59.382819 22839 heartbeater.cc:503] Master 127.10.174.254:42187 was elected leader, sending a full tablet report...
W20260807 18:44:59.409920 22840 tablet.cc:2369] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:44:59.448484 23145 raft_consensus.cc:482] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:44:59.448746 23145 raft_consensus.cc:504] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.450019 23145 leader_election.cc:288] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 552d81d9d2c54b8ca68884db33fd6f3d (127.10.174.194:40735), 7699b57631044b9b97c48cca73bbdd14 (127.10.174.195:39003)
I20260807 18:44:59.455117 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.450866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:35015 (local address 127.10.174.194:40735)
0807 18:44:59.451017 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.451022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.451037 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:44:59.451094 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.451097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.451153 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.451228 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:59.451601 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.452332 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.453872 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.454405 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.454507 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.454565 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.454917 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.454995 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 18:44:59.455734 23146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.450229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:40735 (local address 127.10.174.193:35015)
0807 18:44:59.450636 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.450655 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:59.450795 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:59.451308 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:59.451311 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:59.451336 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:59.451449 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.451455 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.452467 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.452471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.453718 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.453728 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.454679 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.454682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.454780 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.454803 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:44:59.455505 (+ 702us) client_negotiation.cc:240] Negotiation successful
0807 18:44:59.455580 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":137,"threads_started":1}
I20260807 18:44:59.456524 22924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df15c5e661a847058434300eaf075fd8" candidate_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" is_pre_election: true
I20260807 18:44:59.456650 23147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.450517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39003 (local address 127.10.174.193:53129)
0807 18:44:59.451477 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.451492 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:44:59.451622 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:44:59.451965 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:44:59.451968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:44:59.451984 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:44:59.452084 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.452088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.453061 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.453064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.455267 (+ 2203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:44:59.455280 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.456259 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.456262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:44:59.456351 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.456367 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 18:44:59.456459 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 18:44:59.456525 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"thread_start_us":97,"threads_started":1}
I20260807 18:44:59.456703 23136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.451082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:53129 (local address 127.10.174.195:39003)
0807 18:44:59.451215 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.451221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.451558 (+ 337us) server_negotiation.cc:407] Connection header received
0807 18:44:59.451736 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.451740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.451787 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.451835 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:44:59.452196 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.452905 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.455442 (+ 2537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.456019 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.456111 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.456156 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.456496 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.456570 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:44:59.456861 22924 raft_consensus.cc:2454] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9df4c80e9b4f01b2c4436c9f8d7081 in term 0.
I20260807 18:44:59.457266 23070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df15c5e661a847058434300eaf075fd8" candidate_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7699b57631044b9b97c48cca73bbdd14" is_pre_election: true
I20260807 18:44:59.457425 22722 leader_election.cc:302] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 552d81d9d2c54b8ca68884db33fd6f3d, 5e9df4c80e9b4f01b2c4436c9f8d7081; no voters:
I20260807 18:44:59.457554 23070 raft_consensus.cc:2454] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9df4c80e9b4f01b2c4436c9f8d7081 in term 0.
I20260807 18:44:59.457787 23145 raft_consensus.cc:2781] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:44:59.457883 23145 raft_consensus.cc:482] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:44:59.457934 23145 raft_consensus.cc:3037] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:59.459326 23145 raft_consensus.cc:504] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.459728 23145 leader_election.cc:288] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [CANDIDATE]: Term 1 election: Requested vote from peers 552d81d9d2c54b8ca68884db33fd6f3d (127.10.174.194:40735), 7699b57631044b9b97c48cca73bbdd14 (127.10.174.195:39003)
I20260807 18:44:59.460062 22924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df15c5e661a847058434300eaf075fd8" candidate_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552d81d9d2c54b8ca68884db33fd6f3d"
I20260807 18:44:59.460178 22924 raft_consensus.cc:3037] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:59.460177 23070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df15c5e661a847058434300eaf075fd8" candidate_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7699b57631044b9b97c48cca73bbdd14"
I20260807 18:44:59.460307 23070 raft_consensus.cc:3037] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:44:59.461457 22924 raft_consensus.cc:2454] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9df4c80e9b4f01b2c4436c9f8d7081 in term 1.
I20260807 18:44:59.461621 23070 raft_consensus.cc:2454] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9df4c80e9b4f01b2c4436c9f8d7081 in term 1.
I20260807 18:44:59.461866 22722 leader_election.cc:302] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 552d81d9d2c54b8ca68884db33fd6f3d, 5e9df4c80e9b4f01b2c4436c9f8d7081; no voters:
I20260807 18:44:59.462102 23145 raft_consensus.cc:2781] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:44:59.462406 23145 raft_consensus.cc:686] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9df4c80e9b4f01b2c4436c9f8d7081, State: Running, Role: LEADER
I20260807 18:44:59.462739 23145 consensus_queue.cc:237] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } }
I20260807 18:44:59.466853 22618 catalog_manager.cc:5495] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9df4c80e9b4f01b2c4436c9f8d7081 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e9df4c80e9b4f01b2c4436c9f8d7081" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 36525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 } health_report { overall_health: UNKNOWN } } }
W20260807 18:44:59.478566 23119 tablet.cc:2369] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:44:59.501551 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.496626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52070 (local address 127.10.174.193:36525)
0807 18:44:59.496760 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 18:44:59.496765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:44:59.496782 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:44:59.496930 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:44:59.496933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:44:59.497021 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:44:59.497150 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:44:59.497456 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.498241 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.499582 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:44:59.499924 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:44:59.500045 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:44:59.500417 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:44:59.500957 (+ 540us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:44:59.501083 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 18:44:59.501310 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 18:44:59.501377 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:44:59.512569 23070 raft_consensus.cc:1261] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 1 FOLLOWER]: Refusing update from remote peer 5e9df4c80e9b4f01b2c4436c9f8d7081: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:44:59.513653 23145 consensus_queue.cc:1035] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7699b57631044b9b97c48cca73bbdd14" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 07 18:44:59 dist-test-slave-07c2 krb5kdc[22128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:44:59.524273 23153 mvcc.cc:205] Tried to move back new op lower bound from 7315981514790289408 to 7315981514602512384. Current Snapshot: MvccSnapshot[applied={T|T < 7315981514790289408}]
I20260807 18:44:59.524787 22924 raft_consensus.cc:1261] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 1 FOLLOWER]: Refusing update from remote peer 5e9df4c80e9b4f01b2c4436c9f8d7081: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:44:59.525837 23145 consensus_queue.cc:1035] T df15c5e661a847058434300eaf075fd8 P 5e9df4c80e9b4f01b2c4436c9f8d7081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "552d81d9d2c54b8ca68884db33fd6f3d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 40735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:44:59.528982 23154 mvcc.cc:205] Tried to move back new op lower bound from 7315981514790289408 to 7315981514602512384. Current Snapshot: MvccSnapshot[applied={T|T < 7315981514790289408 or (T in {7315981514790289408})}]
I20260807 18:44:59.533695 23160 mvcc.cc:205] Tried to move back new op lower bound from 7315981514790289408 to 7315981514602512384. Current Snapshot: MvccSnapshot[applied={T|T < 7315981514790289408}]
I20260807 18:44:59.536155 22618 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:44:59.536322 22618 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:44:59.539122 22618 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dba521105d6040928d0c4f6e419d94c1: Sending DeleteTablet for 3 replicas of tablet df15c5e661a847058434300eaf075fd8
I20260807 18:44:59.540318 22770 tablet_service.cc:1514] Processing DeleteTablet for tablet df15c5e661a847058434300eaf075fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:44:59 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:52062
I20260807 18:44:59.540557 22912 tablet_service.cc:1514] Processing DeleteTablet for tablet df15c5e661a847058434300eaf075fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:44:59 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:46538
I20260807 18:44:59.541087 23165 tablet_replica.cc:330] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: stopping tablet replica
I20260807 18:44:59.541320 23050 tablet_service.cc:1514] Processing DeleteTablet for tablet df15c5e661a847058434300eaf075fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:44:59 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:46320
I20260807 18:44:59.541450 23165 raft_consensus.cc:2229] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:44:59.541745 23165 raft_consensus.cc:2258] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:44:59.543440 23165 ts_tablet_manager.cc:1905] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:44:59.544231 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 22704
I20260807 18:44:59.545854 23166 tablet_replica.cc:330] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: stopping tablet replica
I20260807 18:44:59.547104 23166 raft_consensus.cc:2229] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:44:59.547511 23165 ts_tablet_manager.cc:1918] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:44:59.547694 23165 log.cc:1196] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/df15c5e661a847058434300eaf075fd8
I20260807 18:44:59.547530 23166 raft_consensus.cc:2258] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:44:59.548286 23165 ts_tablet_manager.cc:1939] T df15c5e661a847058434300eaf075fd8 P 552d81d9d2c54b8ca68884db33fd6f3d: Deleting consensus metadata
I20260807 18:44:59.549450 23166 ts_tablet_manager.cc:1905] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:44:59.549640 22602 catalog_manager.cc:4841] TS 552d81d9d2c54b8ca68884db33fd6f3d (127.10.174.194:40735): tablet df15c5e661a847058434300eaf075fd8 (table test-table [id=f7cde2b6bb4c41eda4d1aeda0a68eda9]) successfully deleted
I20260807 18:44:59.552004 23166 ts_tablet_manager.cc:1918] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:44:59.552181 23166 log.cc:1196] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/df15c5e661a847058434300eaf075fd8
I20260807 18:44:59.552781 23166 ts_tablet_manager.cc:1939] T df15c5e661a847058434300eaf075fd8 P 7699b57631044b9b97c48cca73bbdd14: Deleting consensus metadata
I20260807 18:44:59.553535 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 22847
W20260807 18:44:59.553503 22603 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:36525 (error 108)
I20260807 18:44:59.555044 22604 catalog_manager.cc:4841] TS 7699b57631044b9b97c48cca73bbdd14 (127.10.174.195:39003): tablet df15c5e661a847058434300eaf075fd8 (table test-table [id=f7cde2b6bb4c41eda4d1aeda0a68eda9]) successfully deleted
I20260807 18:44:59.555660 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:44:59.555274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:36525 (local address 127.0.0.1:52076)
0807 18:44:59.555444 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 18:44:59.555545 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:36525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 18:44:59.555809 22603 catalog_manager.cc:4584] TS 5e9df4c80e9b4f01b2c4436c9f8d7081 (127.10.174.193:36525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df15c5e661a847058434300eaf075fd8: Network error: Client connection negotiation failed: client connection to 127.10.174.193:36525: connect: Connection refused (error 111)
I20260807 18:44:59.564293 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 22986
I20260807 18:44:59.572399 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 22585
I20260807 18:44:59.587015 10939 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 18:44:59.930969 10939 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 18:44:59.931107 10939 mini_ranger.cc:66] Stopping Ranger...
I20260807 18:45:00.275661 10939 mini_ranger.cc:68] Stopped Ranger
2026-08-07 18:45:00.275 UTC [22159] LOG: received smart shutdown request
2026-08-07 18:45:00.279 UTC [22159] LOG: background worker "logical replication launcher" (PID 22169) exited with exit code 1
2026-08-07 18:45:00.279 UTC [22163] LOG: shutting down
2026-08-07 18:45:00.434 UTC [22159] LOG: database system is shut down
2026-08-07T18:45:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47736 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:45:00 dist-test-slave-07c2 krb5kdc[23177](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:45:00 dist-test-slave-07c2 krb5kdc[23177](info): set up 2 sockets
Aug 07 18:45:00 dist-test-slave-07c2 krb5kdc[23177](info): commencing operation
krb5kdc: starting...
W20260807 18:45:01.625716 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:45:01 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:45:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:45:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/rangeradmin_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/rangeradmin_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/rangerlookup_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/rangerlookup_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
I20260807 18:45:01.787360 10939 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskoRpd7b/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/postgres -l logfile start
2026-08-07 18:45:04.074 UTC [23208] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 18:45:04.074 UTC [23208] LOG: listening on IPv4 address "127.10.174.212", port 55797
2026-08-07 18:45:04.077 UTC [23208] LOG: listening on Unix socket "/tmp/.s.PGSQL.55797"
2026-08-07 18:45:04.097 UTC [23211] LOG: database system was shut down at 2026-08-07 18:45:02 UTC
2026-08-07 18:45:04.100 UTC [23208] LOG: database system is ready to accept connections
I20260807 18:45:05.066167 10939 mini_postgres.cc:96] Postgres bound to 55797
2026-08-07 18:45:05.073 UTC [23219] FATAL: database "slave" does not exist
127.10.174.212:55797 - accepting connections
I20260807 18:45:05.073786 10939 mini_ranger.cc:161] Starting Ranger...
I20260807 18:45:05.088866 10939 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 18:45:05.495548 10939 mini_ranger.cc:87] Created ranger Postgres database
I20260807 18:45:05.495646 10939 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-admin
2026-08-07 18:45:05,778 [I] DB FLAVOR :POSTGRES
2026-08-07 18:45:05,778 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 18:45:05,778 [I] Checking connection..
2026-08-07 18:45:05,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 18:45:06,039 [I] Checking connection passed.
2026-08-07 18:45:06,039 [I] --------- Verifying version history table ---------
2026-08-07 18:45:06,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 18:45:06,305 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 18:45:06,306 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 18:45:06,549 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 18:45:06,549 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 18:45:06,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 18:45:06.784 UTC [23286] WARNING: there is no transaction in progress
2026-08-07 18:45:06,791 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 18:45:06,791 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 18:45:07,041 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 18:45:07,042 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 18:45:07,042 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 18:45:07,298 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 18:45:07,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-07c2.c.gcp-upstream.internal','N') ;"
2026-08-07 18:45:07,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 18:45:08,055 [I] Table x_portal_user does not exist in database ranger
2026-08-07 18:45:08,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 18:45:08,290 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 18:45:08,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 18:45:08,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 18:45:08,789 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 18:45:08,789 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 18:45:09.668 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.683 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.697 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.711 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.725 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.741 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.791 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.797 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.809 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.819 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.829 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.841 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.850 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.856 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.862 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:09.867 UTC [23398] WARNING: there is no transaction in progress
2026-08-07 18:45:10,438 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 18:45:10,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 18:45:10,690 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 18:45:10,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 18:45:10,916 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 18:45:10,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 18:45:11,175 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 18:45:11,175 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 18:45:11,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 18:45:11,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-07c2.c.gcp-upstream.internal';"
2026-08-07 18:45:11,933 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 18:45:11,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 18:45:12,175 [I] DB_PATCHES have already been applied
I20260807 18:45:12.180869 10939 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-admin:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskoRpd7b/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 18:45:12.180958 10939 mini_ranger.cc:193] Using host: 127.10.174.212
I20260807 18:45:12.185073 10939 mini_ranger.cc:227] Ranger admin URL: http://127.10.174.212:33681
Aug 07, 2026 6:45:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:45:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:45:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:45:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:45:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:45:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:45:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 18:45:13.300628 10939 mini_ranger.cc:160] Time spent starting Ranger: real 8.227s user 0.004s sys 0.006s
Aug 07, 2026 6:45:33 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:45:33 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 6:45:33 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:45:33 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:45:34 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 18:45:35.061291 10939 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/rangerkms_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/rangerkms_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.174.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.174.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.174.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/HTTP_127.10.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 18:45:35 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128335, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 18:45:35.148873 10939 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 18:45:35.158565 10939 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 18:45:35.897627 10939 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 18:45:35.897738 10939 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms
I20260807 18:45:35.897760 10939 mini_ranger_kms.cc:227] Using postgres at 127.10.174.212:55797
2026-08-07 18:45:36,069 [I] DB FLAVOR :POSTGRES
2026-08-07 18:45:36,069 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 18:45:36,069 [I] Checking connection
2026-08-07 18:45:36,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 18:45:36,297 [I] connection success
2026-08-07 18:45:36,297 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 18:45:36,297 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 18:45:36,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 18:45:36,541 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 18:45:36,542 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 18:45:36,542 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 18:45:36,542 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.174.212:55797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 18:45:36,824 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 18:45:37.284929 10939 mini_ranger_kms.cc:310] Created kms service
I20260807 18:45:37.467742 10939 mini_ranger_kms.cc:326] Created kudu user
I20260807 18:45:37.510468 10939 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 18:45:37 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128335, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:37.934386 10939 mini_ranger_kms.cc:384] Added ranger policy
I20260807 18:45:37.934537 10939 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms:/tmp/dist-test-taskoRpd7b/build/debug/bin/postgresql.jar:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskoRpd7b/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 18:45:37.934561 10939 mini_ranger_kms.cc:240] Using host: 127.10.174.212
I20260807 18:45:37.938870 10939 mini_ranger_kms.cc:276] Ranger KMS PID: 23585
I20260807 18:45:37.938956 10939 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.174.212:35903
Aug 07, 2026 6:45:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:45:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:45:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:45:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:45:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:45:39 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 18:45:40 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786128340, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.174.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:40.209444 10939 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.061s user 0.000s sys 0.157s
I20260807 18:45:40.209582 10939 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 18:45:40.209661 10939 mini_ranger_kms.cc:401] 127.10.174.212:35903/kms/v1/keys
Aug 07 18:45:40 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128340, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.174.212@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
Aug 07 18:45:40 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128340, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.174.212@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
Aug 07 18:45:43 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:45:43.162791 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33859
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:33859
--ranger_config_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:43.274281 23637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:43.274541 23637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:43.274580 23637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:43.278821 23637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:43.278885 23637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:43.278904 23637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:43.278920 23637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:43.278936 23637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:43.284366 23637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.174.212:35903/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:33859
--ranger_config_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:43.285389 23637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:43.286432 23637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:43.295189 23643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:43.295378 23637 server_base.cc:1034] running on GCE node
W20260807 18:45:43.295195 23645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:43.295204 23642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:43.296386 23637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:43.297816 23637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:43.299021 23637 hybrid_clock.cc:648] HybridClock initialized: now 1786128343298987 us; error 44 us; skew 500 ppm
Aug 07 18:45:43 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:43.307400 23637 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:43.308369 23637 webserver.cc:460] Webserver started at http://127.10.174.254:35639/ using document root <none> and password file <none>
I20260807 18:45:43.308959 23637 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:43.309044 23637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:43.309283 23637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:45:43 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:43.372103 23637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "c69dac4c220246eeb376ca546a5f019d"
format_stamp: "Formatted at 2026-08-07 18:45:43 on dist-test-slave-07c2"
server_key: "2a30edb171b3bcbd3312d7e311d95f75"
server_key_iv: "834e59aeec9a7f86d8ab277560e1d9b5"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:43.372752 23637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "c69dac4c220246eeb376ca546a5f019d"
format_stamp: "Formatted at 2026-08-07 18:45:43 on dist-test-slave-07c2"
server_key: "2a30edb171b3bcbd3312d7e311d95f75"
server_key_iv: "834e59aeec9a7f86d8ab277560e1d9b5"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:43.376891 23637 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:45:43.393616 23652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:43.395224 23637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:45:43.395388 23637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "c69dac4c220246eeb376ca546a5f019d"
format_stamp: "Formatted at 2026-08-07 18:45:43 on dist-test-slave-07c2"
server_key: "2a30edb171b3bcbd3312d7e311d95f75"
server_key_iv: "834e59aeec9a7f86d8ab277560e1d9b5"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:43.395526 23637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:43.410964 23637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:43.414080 23637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:43.414274 23637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:43.422727 23706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:33859 every 8 connection(s)
I20260807 18:45:43.422735 23637 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:33859
I20260807 18:45:43.423923 23637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:43.426663 23707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:43.430550 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 23637
I20260807 18:45:43.430688 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:45:43.430979 10939 external_mini_cluster.cc:1428] Setting key 001ac79b5b9996971938fdc93bf3755f
I20260807 18:45:43.432633 23707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Bootstrap starting.
I20260807 18:45:43.434942 23707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:43.435895 23707 log.cc:824] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:43.437853 23707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: No bootstrap required, opened a new log
Aug 07 18:45:43 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:43.442175 23707 raft_consensus.cc:348] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:43.442469 23707 raft_consensus.cc:374] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:43.442534 23707 raft_consensus.cc:729] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c69dac4c220246eeb376ca546a5f019d, State: Initialized, Role: FOLLOWER
I20260807 18:45:43.443058 23707 consensus_queue.cc:260] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:43.443248 23707 raft_consensus.cc:388] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:45:43.443351 23707 raft_consensus.cc:482] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:45:43.443483 23707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:43.444733 23707 raft_consensus.cc:504] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:43.445072 23707 leader_election.cc:302] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c69dac4c220246eeb376ca546a5f019d; no voters:
I20260807 18:45:43.445420 23707 leader_election.cc:288] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:45:43.445555 23712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:43.445808 23712 raft_consensus.cc:686] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 LEADER]: Becoming Leader. State: Replica: c69dac4c220246eeb376ca546a5f019d, State: Running, Role: LEADER
I20260807 18:45:43.446136 23712 consensus_queue.cc:237] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:43.446698 23707 sys_catalog.cc:564] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:43.447402 23712 sys_catalog.cc:455] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c69dac4c220246eeb376ca546a5f019d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } } }
I20260807 18:45:43.447615 23712 sys_catalog.cc:458] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:43.447890 23712 sys_catalog.cc:455] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c69dac4c220246eeb376ca546a5f019d. Latest consensus state: current_term: 1 leader_uuid: "c69dac4c220246eeb376ca546a5f019d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } } }
I20260807 18:45:43.448043 23712 sys_catalog.cc:458] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:43.448243 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:43.432426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34094 (local address 127.10.174.254:33859)
0807 18:45:43.432950 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:43.432968 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:43.433012 (+ 44us) server_negotiation.cc:407] Connection header received
0807 18:45:43.433840 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:43.433862 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:43.434288 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:43.434652 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:43.435697 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:43.437183 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:43.438369 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:43.439052 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:43.439217 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:43.442330 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:43.442336 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:43.442351 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:43.442382 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:43.444450 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:43.444962 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:43.444967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:43.444973 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:43.445115 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:43.445518 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:43.445521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:43.445522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:43.446005 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:43.446854 (+ 849us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:43.446995 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 18:45:43.447269 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":147,"threads_started":1}
I20260807 18:45:43.448637 23722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:43.449012 23707 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 18:45:43.451864 23722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:43.464908 23722 catalog_manager.cc:1347] Generated new cluster ID: 7e1e7b16f6f041f09cec7624be9487d6
I20260807 18:45:43.464998 23722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:45:43.475776 23722 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:45:43.477037 23722 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:45:43.486639 23722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Generated new TSK 0
I20260807 18:45:43.487533 23722 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:45:44.258666 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33859
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:44.379771 23753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:44.379994 23753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:44.380034 23753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:44.385599 23753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:44.385654 23753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:44.385733 23753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:45:44.391233 23753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.174.212:35903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:44.392314 23753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:44.393297 23753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:44.403213 23762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:44.403426 23760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:44.403198 23759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:44.404418 23753 server_base.cc:1034] running on GCE node
I20260807 18:45:44.405467 23753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:44.406097 23753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:44.407337 23753 hybrid_clock.cc:648] HybridClock initialized: now 1786128344407314 us; error 41 us; skew 500 ppm
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:44.410595 23753 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:45:44.411633 23753 webserver.cc:460] Webserver started at http://127.10.174.193:40423/ using document root <none> and password file <none>
I20260807 18:45:44.412416 23753 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:44.412488 23753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:44.412741 23753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:44.429087 23753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "8ddb604b63374cc5831bdde4889963f0"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "aaf93b704fa24707af5c72c43f018473"
server_key_iv: "88379afb0328fbbc9278fac96934df12"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:44.429767 23753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "8ddb604b63374cc5831bdde4889963f0"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "aaf93b704fa24707af5c72c43f018473"
server_key_iv: "88379afb0328fbbc9278fac96934df12"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:44.440768 23753 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.006s sys 0.000s
I20260807 18:45:44.463634 23772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:44.465242 23753 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260807 18:45:44.465426 23753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "8ddb604b63374cc5831bdde4889963f0"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "aaf93b704fa24707af5c72c43f018473"
server_key_iv: "88379afb0328fbbc9278fac96934df12"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:44.465647 23753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:44.489156 23753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:44.492172 23753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:44.492373 23753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:44.493078 23753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:44.493997 23753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:44.494059 23753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:44.494154 23753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:44.494202 23753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:44.505981 23753 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:40477
I20260807 18:45:44.507179 23753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:45:44.514896 23890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:40477 every 8 connection(s)
I20260807 18:45:44.516525 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 23753
I20260807 18:45:44.516672 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:45:44.516999 10939 external_mini_cluster.cc:1428] Setting key 80d3115a65886d2d857658ee152bae59
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:44.534772 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:44.518877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:57971 (local address 127.10.174.254:33859)
0807 18:45:44.519151 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:44.519156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:44.519702 (+ 546us) server_negotiation.cc:407] Connection header received
0807 18:45:44.521018 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:44.521021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:44.521092 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:44.521160 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:44.523091 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.523977 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.525670 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.526083 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.526172 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:44.529618 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:44.529625 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:44.529631 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:44.529667 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:44.531815 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:44.532578 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:44.532584 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:44.532587 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:44.532704 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:44.533202 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:44.533207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:44.533210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:44.533477 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:44.533583 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:44.534450 (+ 867us) server_negotiation.cc:299] Negotiation successful
0807 18:45:44.534581 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":96,"threads_started":1}
I20260807 18:45:44.535743 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:44.517550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33859 (local address 127.10.174.193:57971)
0807 18:45:44.519535 (+ 1985us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:44.519599 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:44.520765 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:44.521643 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:44.521664 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:44.522147 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:44.522915 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:44.522937 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.524147 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.524152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:44.525506 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:44.525518 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.526436 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.526441 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:44.526641 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:44.527472 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:44.527494 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:44.529411 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:44.531964 (+ 2553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:44.531972 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:44.532006 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:44.532419 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:44.532830 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:44.532836 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:44.532841 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:44.533060 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:44.533644 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:44.533650 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:44.533989 (+ 339us) client_negotiation.cc:769] Sending connection context
0807 18:45:44.534237 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 18:45:44.534587 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1728,"thread_start_us":177,"threads_started":1}
I20260807 18:45:44.537771 23891 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33859
I20260807 18:45:44.538020 23891 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:44.538686 23891 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:45:44.540552 23671 ts_manager.cc:194] Registered new tserver with Master: 8ddb604b63374cc5831bdde4889963f0 (127.10.174.193:40477)
I20260807 18:45:44.542086 23671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:57971
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:45:44.564556 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33859
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 18:45:44.695071 23899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:44.695355 23899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:44.695464 23899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:44.699635 23899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:44.699702 23899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:44.699875 23899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:45:44.705451 23899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.174.212:35903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:44.706467 23899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:44.707559 23899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:44.717396 23906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:44.717314 23905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:44.717711 23899 server_base.cc:1034] running on GCE node
W20260807 18:45:44.717478 23908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:44.718246 23899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:44.718905 23899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:44.720090 23899 hybrid_clock.cc:648] HybridClock initialized: now 1786128344720062 us; error 46 us; skew 500 ppm
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:44.723572 23899 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:45:44.724490 23899 webserver.cc:460] Webserver started at http://127.10.174.194:46741/ using document root <none> and password file <none>
I20260807 18:45:44.725013 23899 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:44.725111 23899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:44.725329 23899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:44.740530 23899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "eebf6e8c4e65477a8556b3b35e01975d"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "41545556e17132e8f935307ee88de0f1"
server_key_iv: "943027d25faaa29d37f96e4de5db866b"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:44.741183 23899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "eebf6e8c4e65477a8556b3b35e01975d"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "41545556e17132e8f935307ee88de0f1"
server_key_iv: "943027d25faaa29d37f96e4de5db866b"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:44.745981 23899 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 18:45:44.769438 23916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:44.771430 23899 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.000s
I20260807 18:45:44.771566 23899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "eebf6e8c4e65477a8556b3b35e01975d"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "41545556e17132e8f935307ee88de0f1"
server_key_iv: "943027d25faaa29d37f96e4de5db866b"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:44.771708 23899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:44.786943 23899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:44.790782 23899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:44.791002 23899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:44.791793 23899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:44.792707 23899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:44.792776 23899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:44.792873 23899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:44.792917 23899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:44.806492 23899 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44253
I20260807 18:45:44.807583 23899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:45:44.814451 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 23899
I20260807 18:45:44.814862 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:45:44.815171 10939 external_mini_cluster.cc:1428] Setting key 6b7e7f7ccb5b18c2d31f1a54c2a7cadb
I20260807 18:45:44.819747 24033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44253 every 8 connection(s)
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Aug 07 18:45:44 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:44.839323 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:44.823221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:53297 (local address 127.10.174.254:33859)
0807 18:45:44.823386 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:44.823391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:44.823956 (+ 565us) server_negotiation.cc:407] Connection header received
0807 18:45:44.825509 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:44.825515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:44.825582 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:44.825644 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:44.827396 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.828282 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.830036 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.830450 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.830574 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:44.834244 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:44.834249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:44.834253 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:44.834287 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:44.836252 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:44.836957 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:44.836964 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:44.836969 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:44.837075 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:44.837565 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:44.837573 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:44.837578 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:44.837875 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:44.837989 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:44.838832 (+ 843us) server_negotiation.cc:299] Negotiation successful
0807 18:45:44.839000 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 18:45:44.841168 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:44.822054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33859 (local address 127.10.174.194:53297)
0807 18:45:44.823780 (+ 1726us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:44.823846 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:44.825196 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:44.826085 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:44.826096 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:44.826445 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:44.827165 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:44.827186 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.828397 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.828400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:44.829878 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:44.829889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:44.830696 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:44.830707 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:44.831013 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:44.831765 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:44.831789 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:44.834011 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:44.836380 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:44.836390 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:44.836410 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:44.836815 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:44.837218 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:44.837225 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:44.837230 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:44.837436 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:44.838095 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:44.838105 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:44.838488 (+ 383us) client_negotiation.cc:769] Sending connection context
0807 18:45:44.839533 (+ 1045us) client_negotiation.cc:240] Negotiation successful
0807 18:45:44.839917 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1473,"thread_start_us":189,"threads_started":1}
I20260807 18:45:44.842784 24034 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33859
I20260807 18:45:44.843040 24034 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:44.843668 24034 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:44.844806 23671 ts_manager.cc:194] Registered new tserver with Master: eebf6e8c4e65477a8556b3b35e01975d (127.10.174.194:44253)
I20260807 18:45:44.845681 23671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:53297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:45:44.856412 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33859
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:45.019630 24039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:45.020002 24039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:45.020072 24039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:45.026281 24039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:45.026427 24039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:45.026615 24039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:45:45.035493 24039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.174.212:35903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:45.036924 24039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:45.038425 24039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:45.051800 24045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:45.052338 24047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:45.052603 24039 server_base.cc:1034] running on GCE node
W20260807 18:45:45.054466 24044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:45.055017 24039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:45.055753 24039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:45.056922 24039 hybrid_clock.cc:648] HybridClock initialized: now 1786128345056841 us; error 104 us; skew 500 ppm
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:45.060837 24039 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:45:45.062053 24039 webserver.cc:460] Webserver started at http://127.10.174.195:34911/ using document root <none> and password file <none>
I20260807 18:45:45.062585 24039 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:45.062635 24039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:45.062793 24039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:45.084185 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "40914e880460437992a8ea4e81e37768"
format_stamp: "Formatted at 2026-08-07 18:45:45 on dist-test-slave-07c2"
server_key: "446816dd3201f304af1a34edb5c6c845"
server_key_iv: "590aa44cd2b916e1d18ac3c4a33d0b6e"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:45.085035 24039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "40914e880460437992a8ea4e81e37768"
format_stamp: "Formatted at 2026-08-07 18:45:45 on dist-test-slave-07c2"
server_key: "446816dd3201f304af1a34edb5c6c845"
server_key_iv: "590aa44cd2b916e1d18ac3c4a33d0b6e"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:45.092818 24039 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260807 18:45:45.112419 24054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.114099 24039 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260807 18:45:45.114241 24039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "40914e880460437992a8ea4e81e37768"
format_stamp: "Formatted at 2026-08-07 18:45:45 on dist-test-slave-07c2"
server_key: "446816dd3201f304af1a34edb5c6c845"
server_key_iv: "590aa44cd2b916e1d18ac3c4a33d0b6e"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:45.114395 24039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:45.140368 24039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128344, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:45.144771 24039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:45.144984 24039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:45.145797 24039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:45.146901 24039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:45.146970 24039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.147039 24039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:45.147075 24039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.160005 24039 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:40341
I20260807 18:45:45.161257 24039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:45:45.162498 24172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:40341 every 8 connection(s)
I20260807 18:45:45.169763 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24039
I20260807 18:45:45.169890 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:45:45.170219 10939 external_mini_cluster.cc:1428] Setting key 6e423cf7182bd92e85301ec79fece26f
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:45.182999 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:45.168520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:50337 (local address 127.10.174.254:33859)
0807 18:45:45.168677 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:45.168682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:45.169188 (+ 506us) server_negotiation.cc:407] Connection header received
0807 18:45:45.170595 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:45.170599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:45.170656 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:45.170740 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:45.172628 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.173452 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.175162 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.175521 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.175599 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:45.178778 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:45.178782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:45.178785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:45.178812 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:45.180594 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:45.181198 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:45.181201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:45.181203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:45.181285 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:45.181747 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:45.181751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:45.181753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:45.181955 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:45.182020 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:45.182705 (+ 685us) server_negotiation.cc:299] Negotiation successful
0807 18:45:45.182837 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 18:45:45.184602 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:45.167373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33859 (local address 127.10.174.195:50337)
0807 18:45:45.169016 (+ 1643us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:45.169076 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:45.170338 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:45.171458 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:45.171467 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:45.171803 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:45.172452 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:45.172471 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.173633 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.173636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:45.175004 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:45.175015 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.175856 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.175863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:45.176057 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:45.176887 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:45.176907 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:45.178592 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:45.180735 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:45.180741 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:45.180758 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:45.181078 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:45.181386 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:45.181389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:45.181391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:45.181641 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:45.182108 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:45.182114 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:45.182413 (+ 299us) client_negotiation.cc:769] Sending connection context
0807 18:45:45.183225 (+ 812us) client_negotiation.cc:240] Negotiation successful
0807 18:45:45.183579 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1396,"thread_start_us":161,"threads_started":1}
I20260807 18:45:45.185777 24173 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33859
I20260807 18:45:45.186004 24173 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:45.186540 24173 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:45.187613 23671 ts_manager.cc:194] Registered new tserver with Master: 40914e880460437992a8ea4e81e37768 (127.10.174.195:40341)
I20260807 18:45:45.188326 23671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:50337
I20260807 18:45:45.196197 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:45:45.197021 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 23753
I20260807 18:45:45.213706 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 23899
I20260807 18:45:45.225028 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24039
I20260807 18:45:45.235893 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 23637
I20260807 18:45:45.245537 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33859
--webserver_interface=127.10.174.254
--webserver_port=35639
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:33859
--ranger_config_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:45.355305 24176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:45.355535 24176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:45.355613 24176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:45.359555 24176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:45.359609 24176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:45.359628 24176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:45.359683 24176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:45.359719 24176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:45.365183 24176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:33859
--ranger_config_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=35639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:45.366168 24176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:45.367161 24176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:45.375171 24181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:45.375187 24184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:45.375224 24182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:45.375375 24176 server_base.cc:1034] running on GCE node
I20260807 18:45:45.376055 24176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:45.377005 24176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:45.378171 24176 hybrid_clock.cc:648] HybridClock initialized: now 1786128345378160 us; error 38 us; skew 500 ppm
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:45.380864 24176 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:45.381673 24176 webserver.cc:460] Webserver started at http://127.10.174.254:35639/ using document root <none> and password file <none>
I20260807 18:45:45.382125 24176 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:45.382189 24176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:45.455411 24176 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:45:45.457686 24193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.459008 24176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:45:45.459157 24176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "c69dac4c220246eeb376ca546a5f019d"
format_stamp: "Formatted at 2026-08-07 18:45:43 on dist-test-slave-07c2"
server_key: "2a30edb171b3bcbd3312d7e311d95f75"
server_key_iv: "834e59aeec9a7f86d8ab277560e1d9b5"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:45.459781 24176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:45.486097 24176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:45.489151 24176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:45.489360 24176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:45.496690 24176 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:33859
I20260807 18:45:45.496721 24247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:33859 every 8 connection(s)
I20260807 18:45:45.497715 24176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:45.501857 24248 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:45:45.503402 24248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Bootstrap starting.
I20260807 18:45:45.503923 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24176
I20260807 18:45:45.504436 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:40477
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:33859
--webserver_port=40423
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:45.520681 24248 log.cc:824] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:45.527084 24248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:45:45.527505 24248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Bootstrap complete.
I20260807 18:45:45.531723 24248 raft_consensus.cc:348] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:45.532094 24248 raft_consensus.cc:729] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c69dac4c220246eeb376ca546a5f019d, State: Initialized, Role: FOLLOWER
I20260807 18:45:45.532557 24248 consensus_queue.cc:260] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:45.532696 24248 raft_consensus.cc:388] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:45:45.532764 24248 raft_consensus.cc:482] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:45:45.532881 24248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:45:45.534690 24248 raft_consensus.cc:504] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:45.535015 24248 leader_election.cc:302] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c69dac4c220246eeb376ca546a5f019d; no voters:
I20260807 18:45:45.535363 24248 leader_election.cc:288] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:45:45.535439 24252 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:45:45.535713 24252 raft_consensus.cc:686] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [term 2 LEADER]: Becoming Leader. State: Replica: c69dac4c220246eeb376ca546a5f019d, State: Running, Role: LEADER
I20260807 18:45:45.536062 24252 consensus_queue.cc:237] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } }
I20260807 18:45:45.536586 24248 sys_catalog.cc:564] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:45.537420 24253 sys_catalog.cc:455] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c69dac4c220246eeb376ca546a5f019d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } } }
I20260807 18:45:45.537545 24253 sys_catalog.cc:458] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:45.537922 24254 sys_catalog.cc:455] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c69dac4c220246eeb376ca546a5f019d. Latest consensus state: current_term: 2 leader_uuid: "c69dac4c220246eeb376ca546a5f019d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c69dac4c220246eeb376ca546a5f019d" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33859 } } }
I20260807 18:45:45.538062 24254 sys_catalog.cc:458] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:45.538399 24261 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:45.541471 24261 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:45.542047 24248 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 18:45:45.542109 24261 catalog_manager.cc:1259] Loaded cluster ID: 7e1e7b16f6f041f09cec7624be9487d6
I20260807 18:45:45.542290 24261 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:45:45.548645 24261 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:45:45.550374 24261 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Loaded TSK: 0
I20260807 18:45:45.552223 24261 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 18:45:45.650782 24250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:45.651090 24250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:45.651154 24250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:45.657487 24250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:45.657567 24250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:45.657651 24250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:45:45.665298 24250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:40477
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=40423
--tserver_master_addrs=127.10.174.254:33859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:45.666497 24250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:45.667778 24250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:45:45.680799 24250 server_base.cc:1034] running on GCE node
W20260807 18:45:45.680724 24289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:45.680954 24287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:45.681160 24286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:45.681715 24250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:45.682543 24250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:45.683758 24250 hybrid_clock.cc:648] HybridClock initialized: now 1786128345683703 us; error 65 us; skew 500 ppm
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:45.687779 24250 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:45:45.688858 24250 webserver.cc:460] Webserver started at http://127.10.174.193:40423/ using document root <none> and password file <none>
I20260807 18:45:45.689495 24250 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:45.689589 24250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:45.722298 24250 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.003s sys 0.000s
I20260807 18:45:45.725011 24298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.726437 24250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 18:45:45.726581 24250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "8ddb604b63374cc5831bdde4889963f0"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "aaf93b704fa24707af5c72c43f018473"
server_key_iv: "88379afb0328fbbc9278fac96934df12"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:45.727238 24250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:45.748796 24250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:45.752574 24250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:45.752785 24250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:45.753480 24250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:45.754459 24250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:45.754525 24250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.754578 24250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:45.754608 24250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:45.770112 24250 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:40477
I20260807 18:45:45.771530 24250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:45:45.778153 24413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:40477 every 8 connection(s)
I20260807 18:45:45.778584 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24250
I20260807 18:45:45.779122 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:44253
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:33859
--webserver_port=46741
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:45.799922 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:45.782210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:36201 (local address 127.10.174.254:33859)
0807 18:45:45.782869 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:45.782893 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:45.782960 (+ 67us) server_negotiation.cc:407] Connection header received
0807 18:45:45.784256 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:45.784272 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:45.784651 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:45.785000 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:45.786287 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.787866 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.789254 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.789985 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.790163 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:45.793627 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:45.793633 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:45.793649 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:45.793697 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:45.795943 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:45.796650 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:45.796656 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:45.796663 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:45.796808 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:45.797247 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:45.797250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:45.797252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:45.797739 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:45.797883 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:45.798579 (+ 696us) server_negotiation.cc:299] Negotiation successful
0807 18:45:45.798882 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":166,"threads_started":1}
I20260807 18:45:45.799934 24417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:45.780682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33859 (local address 127.10.174.193:36201)
0807 18:45:45.782663 (+ 1981us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:45.782720 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:45.783786 (+ 1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:45.785106 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:45.785114 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:45.785476 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:45.786089 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:45.786107 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.788029 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.788032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:45.789111 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:45.789122 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:45.790163 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:45.790170 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:45.790398 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:45.791153 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:45.791179 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:45.793408 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:45.796071 (+ 2663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:45.796079 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:45.796096 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:45.796509 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:45.796917 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:45.796920 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:45.796924 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:45.797116 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:45.797873 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:45.797882 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:45.798195 (+ 313us) client_negotiation.cc:769] Sending connection context
0807 18:45:45.798446 (+ 251us) client_negotiation.cc:240] Negotiation successful
0807 18:45:45.798839 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1743,"thread_start_us":195,"threads_started":1}
I20260807 18:45:45.803431 24414 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33859
I20260807 18:45:45.803689 24414 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:45.804210 24414 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
W20260807 18:45:45.806386 24414 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:33859 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 18:45:45.806499 24414 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:45.806664 24414 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:45.807535 24414 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:45.807694 24414 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
W20260807 18:45:45.808446 24414 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 18:45:45.942230 24416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:45.942584 24416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:45.942720 24416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:45.947499 24416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:45.947562 24416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:45.947645 24416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:45:45.953100 24416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:44253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=46741
--tserver_master_addrs=127.10.174.254:33859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:45.954077 24416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:45.955026 24416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:45.965083 24424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:45.965127 24427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:45.965673 24416 server_base.cc:1034] running on GCE node
W20260807 18:45:45.966822 24423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:45.967381 24416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:45.968149 24416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:45.975548 24416 hybrid_clock.cc:648] HybridClock initialized: now 1786128345975502 us; error 50 us; skew 500 ppm
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:45.979460 24416 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:45:45.980406 24416 webserver.cc:460] Webserver started at http://127.10.174.194:46741/ using document root <none> and password file <none>
I20260807 18:45:45.980957 24416 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:45.981030 24416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 18:45:45 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:46.005194 24416 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 18:45:46.008306 24435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:46.009738 24416 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:45:46.009867 24416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "eebf6e8c4e65477a8556b3b35e01975d"
format_stamp: "Formatted at 2026-08-07 18:45:44 on dist-test-slave-07c2"
server_key: "41545556e17132e8f935307ee88de0f1"
server_key_iv: "943027d25faaa29d37f96e4de5db866b"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:46.010557 24416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:46.025758 24416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:46.029384 24416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:46.029569 24416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:46.030182 24416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:46.031152 24416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:46.031205 24416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:46.031255 24416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:46.031276 24416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:46.045138 24416 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44253
I20260807 18:45:46.046878 24416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:45:46.047664 24551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44253 every 8 connection(s)
I20260807 18:45:46.055055 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24416
I20260807 18:45:46.055605 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.174.212:35903/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:40341
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:33859
--webserver_port=34911
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:45:46 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:46.061846 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:46.049415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:52753 (local address 127.10.174.254:33859)
0807 18:45:46.049548 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:46.049552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:46.050646 (+ 1094us) server_negotiation.cc:407] Connection header received
0807 18:45:46.051684 (+ 1038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:46.051687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:46.051750 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:46.051857 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:46.052952 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.053587 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.054750 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.054979 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.055089 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:46.057508 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:46.057512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:46.057519 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:46.057542 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:46.059374 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:46.060026 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:46.060031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:46.060033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:46.060126 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:46.060554 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:46.060558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:46.060560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:46.060787 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:46.060862 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:46.061531 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 18:45:46.061665 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:45:46.063446 24555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:46.049947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33859 (local address 127.10.174.194:52753)
0807 18:45:46.050494 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:46.050536 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:46.051481 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:46.052021 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:46.052028 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:46.052298 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:46.052798 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:46.052812 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.053735 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.053737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:46.054595 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:46.054604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.055126 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.055129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:46.055374 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:46.056027 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:46.056042 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:46.057339 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:46.059516 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:46.059522 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:46.059535 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:46.059883 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:46.060257 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:46.060260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:46.060262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:46.060438 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:46.060948 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:46.060954 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:46.061248 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 18:45:46.062078 (+ 830us) client_negotiation.cc:240] Negotiation successful
0807 18:45:46.062408 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":198,"threads_started":1}
I20260807 18:45:46.065925 24553 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33859
I20260807 18:45:46.066177 24553 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.066659 24553 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
W20260807 18:45:46.068404 24553 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:33859 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 18:45:46.068543 24553 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.068729 24553 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:46.069665 24553 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.069851 24553 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
W20260807 18:45:46.070693 24553 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 18:45:46.216820 24556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:46.217284 24556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:46.217371 24556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:46.222595 24556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:46.222676 24556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:46.222775 24556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:45:46.229384 24556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.174.212:35903/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:40341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=34911
--tserver_master_addrs=127.10.174.254:33859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:46.230425 24556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:46.231503 24556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:46.242084 24562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:46.242408 24563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:46.242709 24565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:46.243773 24556 server_base.cc:1034] running on GCE node
I20260807 18:45:46.244230 24556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:46.244985 24556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:46.248279 24556 hybrid_clock.cc:648] HybridClock initialized: now 1786128346248252 us; error 44 us; skew 500 ppm
Aug 07 18:45:46 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:46.251056 24556 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:45:46.252128 24556 webserver.cc:460] Webserver started at http://127.10.174.195:34911/ using document root <none> and password file <none>
I20260807 18:45:46.252678 24556 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:46.252792 24556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 18:45:46 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:46.275274 24556 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 18:45:46.278589 24573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:46.280072 24556 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 18:45:46.280180 24556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "40914e880460437992a8ea4e81e37768"
format_stamp: "Formatted at 2026-08-07 18:45:45 on dist-test-slave-07c2"
server_key: "446816dd3201f304af1a34edb5c6c845"
server_key_iv: "590aa44cd2b916e1d18ac3c4a33d0b6e"
server_key_version: "kuduclusterkey@0"
I20260807 18:45:46.281014 24556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:46.295554 24556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:46.299397 24556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:46.299614 24556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:46.300324 24556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:46.301290 24556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:46.301358 24556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:46.301414 24556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:46.301643 24556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 18:45:46.317430 24556 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:40341
I20260807 18:45:46.318742 24556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:45:46.319662 24690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:40341 every 8 connection(s)
I20260807 18:45:46.325310 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24556
Aug 07 18:45:46 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:46.337888 24696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:46.326584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.10.174.254:33859)
0807 18:45:46.326836 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:46.326840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:46.327615 (+ 775us) server_negotiation.cc:407] Connection header received
0807 18:45:46.327809 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:46.327812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:46.327863 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:46.327931 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:46.329035 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.329814 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.331120 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.331520 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.331616 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:46.333436 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:46.333440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:46.333443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:46.333484 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:46.335399 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:46.336356 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:46.336360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:46.336362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:46.336502 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:46.336851 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:46.336856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:46.336858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:46.337130 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:46.337346 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:46.337533 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 18:45:46.337678 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":190,"thread_start_us":99,"threads_started":1}
I20260807 18:45:46.340873 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:46.321539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:40115 (local address 127.10.174.254:33859)
0807 18:45:46.321687 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:46.321692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:46.322560 (+ 868us) server_negotiation.cc:407] Connection header received
0807 18:45:46.323751 (+ 1191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:46.323755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:46.323814 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:46.323877 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:46.325586 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.326364 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.327940 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.328332 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.328420 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:46.335691 (+ 7271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:46.335693 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:46.335695 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:46.335716 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:46.337502 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:46.338747 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:46.338751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:46.338752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:46.338875 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:46.339761 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:46.339765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:46.339766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:46.339974 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:46.340065 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:46.340569 (+ 504us) server_negotiation.cc:299] Negotiation successful
0807 18:45:46.340697 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":68}
I20260807 18:45:46.341674 24693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:46.321952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33859 (local address 127.10.174.195:40115)
0807 18:45:46.322394 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:46.322446 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:46.323492 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:46.324281 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:46.324291 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:46.324717 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:46.325383 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:46.325407 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.326558 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.326562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:46.327816 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:46.327826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:46.328654 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:46.328661 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:46.328867 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:46.330221 (+ 1354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:46.330243 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:46.335480 (+ 5237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:46.338076 (+ 2596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:46.338082 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:46.338099 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:46.338612 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:46.339017 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:46.339020 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:46.339021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:46.339230 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:46.340089 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:46.340094 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:46.340329 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 18:45:46.340474 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 18:45:46.340711 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":134,"threads_started":1}
I20260807 18:45:46.342824 24691 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33859
I20260807 18:45:46.343057 24691 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.343575 24691 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
W20260807 18:45:46.344998 24691 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:33859 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 18:45:46.345120 24691 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.345271 24691 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:46.346074 24691 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.346236 24691 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
W20260807 18:45:46.346971 24691 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 18:45:46 dist-test-slave-07c2 krb5kdc[23177](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786128346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:46.808641 24414 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:46.808923 24414 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:46.809903 24210 ts_manager.cc:194] Registered new tserver with Master: 8ddb604b63374cc5831bdde4889963f0 (127.10.174.193:40477)
I20260807 18:45:46.811072 24210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:36201
I20260807 18:45:47.070936 24553 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:47.071260 24553 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:47.072016 24210 ts_manager.cc:194] Registered new tserver with Master: eebf6e8c4e65477a8556b3b35e01975d (127.10.174.194:44253)
I20260807 18:45:47.072826 24210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:52753
Aug 07 18:45:47 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:47.347239 24691 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:47.347577 24691 heartbeater.cc:511] Master 127.10.174.254:33859 requested a full tablet report, sending...
I20260807 18:45:47.348495 24210 ts_manager.cc:194] Registered new tserver with Master: 40914e880460437992a8ea4e81e37768 (127.10.174.195:40341)
I20260807 18:45:47.349532 24210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:40115
I20260807 18:45:47.352041 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:45:47.363373 24714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.353652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.10.174.254:33859)
0807 18:45:47.354030 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.354035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.354053 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:45:47.354144 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.354147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.354196 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.354302 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:47.355115 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.355932 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.357111 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.357463 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.357589 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.359270 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:47.359274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:47.359277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:47.359328 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:47.361175 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:47.361648 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:47.361651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:47.361653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:47.361741 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:47.362009 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:47.362012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:47.362014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:47.362216 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:47.362351 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.363043 (+ 692us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.363168 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":90,"threads_started":1}
I20260807 18:45:47.372017 24210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:45:47.377058 24210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 07 18:45:47 dist-test-slave-07c2 krb5kdc[23177](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for HTTP/127.10.174.212@KRBTEST.COM
I20260807 18:45:47.401258 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.389029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44253 (local address 127.0.0.1:45860)
0807 18:45:47.392400 (+ 3371us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.392451 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:47.392590 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:47.393401 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:47.393409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:47.393436 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:47.393577 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.393585 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.395762 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.395767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.397406 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.397416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.399082 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.399086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.399253 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.399366 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 18:45:47.400949 (+ 1583us) client_negotiation.cc:240] Negotiation successful
0807 18:45:47.401097 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3164,"mutex_wait_us":203,"thread_start_us":118,"threads_started":1}
I20260807 18:45:47.401260 24722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.390141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45860 (local address 127.10.174.194:44253)
0807 18:45:47.390485 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.390492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.392753 (+ 2261us) server_negotiation.cc:407] Connection header received
0807 18:45:47.392843 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.392850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.393065 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.393204 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:47.393731 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.395468 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.397544 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.398760 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.398888 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.399015 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.400997 (+ 1982us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.401109 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":139,"threads_started":1}
I20260807 18:45:47.402635 24724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.391541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37470 (local address 127.10.174.193:40477)
0807 18:45:47.392492 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.392501 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.393054 (+ 553us) server_negotiation.cc:407] Connection header received
0807 18:45:47.393148 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.393155 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.393326 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.393473 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:47.394663 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.395817 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.398019 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.398779 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.398887 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.399015 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.401180 (+ 2165us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.401300 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":842,"thread_start_us":81,"threads_started":1}
I20260807 18:45:47.403237 24723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.391986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:40477 (local address 127.0.0.1:37470)
0807 18:45:47.392881 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.392892 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:47.392967 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:47.394426 (+ 1459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:47.394429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:47.394448 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:47.394529 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.394534 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.395937 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.395940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.397879 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.397891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.399082 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.399086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.399369 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.399386 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 18:45:47.399477 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 18:45:47.403064 (+ 3587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":161,"thread_start_us":105,"threads_started":1}
I20260807 18:45:47.404882 24483 tablet_service.cc:1467] Processing CreateTablet for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a (DEFAULT_TABLE table=test-table [id=c6f9d7fe700248df9fea53dad274c7fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:47.405915 24483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:47.406625 24342 tablet_service.cc:1467] Processing CreateTablet for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a (DEFAULT_TABLE table=test-table [id=c6f9d7fe700248df9fea53dad274c7fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:47.407544 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:47.416239 24728 tablet_bootstrap.cc:492] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: Bootstrap starting.
I20260807 18:45:47.418653 24728 tablet_bootstrap.cc:654] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:47.419724 24728 log.cc:824] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:47.420486 24727 tablet_bootstrap.cc:492] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Bootstrap starting.
I20260807 18:45:47.423333 24727 tablet_bootstrap.cc:654] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:47.424400 24727 log.cc:824] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:47.428836 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.391323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:40341 (local address 127.0.0.1:51124)
0807 18:45:47.392622 (+ 1299us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.392635 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:47.392713 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:47.421669 (+ 28956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:47.421673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:47.421696 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:47.421821 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.421830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.426296 (+ 4466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.426300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.427374 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.427391 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.428335 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.428340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.428430 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.428477 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 18:45:47.428545 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 18:45:47.428639 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"thread_start_us":102,"threads_started":1}
I20260807 18:45:47.429718 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.391771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51124 (local address 127.10.174.195:40341)
0807 18:45:47.421094 (+ 29323us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.421101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.421130 (+ 29us) server_negotiation.cc:407] Connection header received
0807 18:45:47.421214 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.421219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.421483 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.421698 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:47.424943 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.426136 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.427520 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.428179 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.429259 (+ 1080us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.429423 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.429479 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.429576 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29197,"thread_start_us":69,"threads_started":1}
I20260807 18:45:47.433387 24728 tablet_bootstrap.cc:492] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: No bootstrap required, opened a new log
I20260807 18:45:47.433600 24728 ts_tablet_manager.cc:1397] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260807 18:45:47.433178 24603 tablet_service.cc:1467] Processing CreateTablet for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a (DEFAULT_TABLE table=test-table [id=c6f9d7fe700248df9fea53dad274c7fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:47.434306 24603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:47.438277 24728 raft_consensus.cc:348] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.438565 24728 raft_consensus.cc:374] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:47.438624 24728 raft_consensus.cc:729] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ddb604b63374cc5831bdde4889963f0, State: Initialized, Role: FOLLOWER
I20260807 18:45:47.441485 24727 tablet_bootstrap.cc:492] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: No bootstrap required, opened a new log
I20260807 18:45:47.441715 24727 ts_tablet_manager.cc:1397] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260807 18:45:47.444993 24731 tablet_bootstrap.cc:492] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: Bootstrap starting.
I20260807 18:45:47.445945 24727 raft_consensus.cc:348] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.446307 24727 raft_consensus.cc:374] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:47.446383 24727 raft_consensus.cc:729] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eebf6e8c4e65477a8556b3b35e01975d, State: Initialized, Role: FOLLOWER
I20260807 18:45:47.446832 24727 consensus_queue.cc:260] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.447551 24728 consensus_queue.cc:260] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.448053 24731 tablet_bootstrap.cc:654] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:47.448671 24728 ts_tablet_manager.cc:1428] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: Time spent starting tablet: real 0.015s user 0.003s sys 0.004s
I20260807 18:45:47.448989 24731 log.cc:824] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:47.449070 24414 heartbeater.cc:503] Master 127.10.174.254:33859 was elected leader, sending a full tablet report...
I20260807 18:45:47.449604 24727 ts_tablet_manager.cc:1428] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 18:45:47.449906 24553 heartbeater.cc:503] Master 127.10.174.254:33859 was elected leader, sending a full tablet report...
I20260807 18:45:47.452356 24731 tablet_bootstrap.cc:492] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: No bootstrap required, opened a new log
I20260807 18:45:47.452544 24731 ts_tablet_manager.cc:1397] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 18:45:47.456957 24731 raft_consensus.cc:348] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.457218 24731 raft_consensus.cc:374] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:47.457270 24731 raft_consensus.cc:729] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40914e880460437992a8ea4e81e37768, State: Initialized, Role: FOLLOWER
I20260807 18:45:47.457671 24731 consensus_queue.cc:260] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.458560 24731 ts_tablet_manager.cc:1428] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 18:45:47.458911 24691 heartbeater.cc:503] Master 127.10.174.254:33859 was elected leader, sending a full tablet report...
I20260807 18:45:47.468384 24733 raft_consensus.cc:482] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:45:47.468714 24733 raft_consensus.cc:504] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.470166 24733 leader_election.cc:288] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eebf6e8c4e65477a8556b3b35e01975d (127.10.174.194:44253), 40914e880460437992a8ea4e81e37768 (127.10.174.195:40341)
I20260807 18:45:47.479449 24722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.470979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:33011 (local address 127.10.174.194:44253)
0807 18:45:47.471099 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.471104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.475051 (+ 3947us) server_negotiation.cc:407] Connection header received
0807 18:45:47.475252 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.475255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.475327 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.475376 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:47.475867 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.476598 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.478154 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.478739 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.478833 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.478884 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.479231 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.479324 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:45:47.480085 24738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.470458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44253 (local address 127.10.174.193:33011)
0807 18:45:47.474956 (+ 4498us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.474971 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:47.475130 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:47.475506 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:47.475509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:47.475527 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:47.475724 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.475730 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.476751 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.476754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.477986 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.477998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.478981 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.478985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.479081 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.479115 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 18:45:47.479768 (+ 653us) client_negotiation.cc:240] Negotiation successful
0807 18:45:47.479846 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4419,"thread_start_us":109,"threads_started":1}
I20260807 18:45:47.481447 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.470435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:40341 (local address 127.10.174.193:58933)
0807 18:45:47.473674 (+ 3239us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.473690 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:47.473832 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:47.474182 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:47.474185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:47.474204 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:47.474353 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.474360 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.476686 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.476689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.480172 (+ 3483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:47.480183 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.481067 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.481070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:47.481168 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.481190 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 18:45:47.481260 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 18:45:47.481321 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3159,"thread_start_us":127,"threads_started":1}
I20260807 18:45:47.481590 24498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e025d896bae43ef8ee1c0ecbb97ea7a" candidate_uuid: "8ddb604b63374cc5831bdde4889963f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eebf6e8c4e65477a8556b3b35e01975d" is_pre_election: true
I20260807 18:45:47.481875 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.470890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:58933 (local address 127.10.174.195:40341)
0807 18:45:47.471035 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.471040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.473814 (+ 2774us) server_negotiation.cc:407] Connection header received
0807 18:45:47.473930 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.473934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.473982 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.474063 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:47.474484 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.475319 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.480322 (+ 5003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.480949 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.481073 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.481121 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.481679 (+ 558us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.481766 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:45:47.481920 24498 raft_consensus.cc:2454] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb604b63374cc5831bdde4889963f0 in term 0.
I20260807 18:45:47.482386 24643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e025d896bae43ef8ee1c0ecbb97ea7a" candidate_uuid: "8ddb604b63374cc5831bdde4889963f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40914e880460437992a8ea4e81e37768" is_pre_election: true
I20260807 18:45:47.482594 24300 leader_election.cc:302] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb604b63374cc5831bdde4889963f0, eebf6e8c4e65477a8556b3b35e01975d; no voters:
I20260807 18:45:47.482667 24643 raft_consensus.cc:2454] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ddb604b63374cc5831bdde4889963f0 in term 0.
I20260807 18:45:47.482930 24733 raft_consensus.cc:2781] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:45:47.483026 24733 raft_consensus.cc:482] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:45:47.483088 24733 raft_consensus.cc:3037] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:47.484517 24733 raft_consensus.cc:504] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.484951 24733 leader_election.cc:288] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [CANDIDATE]: Term 1 election: Requested vote from peers eebf6e8c4e65477a8556b3b35e01975d (127.10.174.194:44253), 40914e880460437992a8ea4e81e37768 (127.10.174.195:40341)
I20260807 18:45:47.485322 24498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e025d896bae43ef8ee1c0ecbb97ea7a" candidate_uuid: "8ddb604b63374cc5831bdde4889963f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eebf6e8c4e65477a8556b3b35e01975d"
I20260807 18:45:47.485455 24498 raft_consensus.cc:3037] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:47.485778 24643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e025d896bae43ef8ee1c0ecbb97ea7a" candidate_uuid: "8ddb604b63374cc5831bdde4889963f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40914e880460437992a8ea4e81e37768"
I20260807 18:45:47.485908 24643 raft_consensus.cc:3037] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:47.486711 24498 raft_consensus.cc:2454] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb604b63374cc5831bdde4889963f0 in term 1.
I20260807 18:45:47.487018 24300 leader_election.cc:302] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ddb604b63374cc5831bdde4889963f0, eebf6e8c4e65477a8556b3b35e01975d; no voters:
I20260807 18:45:47.487181 24733 raft_consensus.cc:2781] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:47.487422 24733 raft_consensus.cc:686] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [term 1 LEADER]: Becoming Leader. State: Replica: 8ddb604b63374cc5831bdde4889963f0, State: Running, Role: LEADER
I20260807 18:45:47.487463 24643 raft_consensus.cc:2454] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ddb604b63374cc5831bdde4889963f0 in term 1.
I20260807 18:45:47.487813 24733 consensus_queue.cc:237] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } }
I20260807 18:45:47.491218 24210 catalog_manager.cc:5495] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ddb604b63374cc5831bdde4889963f0 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "8ddb604b63374cc5831bdde4889963f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ddb604b63374cc5831bdde4889963f0" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260807 18:45:47.507822 24724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.502739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37486 (local address 127.10.174.193:40477)
0807 18:45:47.502869 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:47.502874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:47.502889 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:45:47.503076 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:47.503079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:47.503142 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:47.503240 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:45:47.503625 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.504404 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.505662 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:47.506007 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:47.506109 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:47.506500 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:45:47.507009 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:45:47.507122 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:47.507607 (+ 485us) server_negotiation.cc:299] Negotiation successful
0807 18:45:47.507663 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:45:47.522725 24643 raft_consensus.cc:1261] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 1 FOLLOWER]: Refusing update from remote peer 8ddb604b63374cc5831bdde4889963f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:47.523468 24740 consensus_queue.cc:1035] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40914e880460437992a8ea4e81e37768" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:47.529498 24498 raft_consensus.cc:1261] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 1 FOLLOWER]: Refusing update from remote peer 8ddb604b63374cc5831bdde4889963f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:47.530226 24740 consensus_queue.cc:1035] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eebf6e8c4e65477a8556b3b35e01975d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 18:45:47.533653 24415 tablet.cc:2369] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 8ddb604b63374cc5831bdde4889963f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:45:47.535756 24743 mvcc.cc:205] Tried to move back new op lower bound from 7315981711440678912 to 7315981711313326080. Current Snapshot: MvccSnapshot[applied={T|T < 7315981711440678912}]
W20260807 18:45:47.549865 24554 tablet.cc:2369] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:45:47.551456 24210 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:45:47.551666 24210 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:45:47.555473 24210 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c69dac4c220246eeb376ca546a5f019d: Sending DeleteTablet for 3 replicas of tablet 4e025d896bae43ef8ee1c0ecbb97ea7a
I20260807 18:45:47.556268 24483 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:47 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:45860
I20260807 18:45:47.557796 24746 mvcc.cc:205] Tried to move back new op lower bound from 7315981711440678912 to 7315981711313326080. Current Snapshot: MvccSnapshot[applied={T|T < 7315981711440678912}]
I20260807 18:45:47.558166 24342 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:47 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:37470
I20260807 18:45:47.559461 24603 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:47 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:51124
I20260807 18:45:47.560807 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24250
I20260807 18:45:47.565441 24753 tablet_replica.cc:330] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: stopping tablet replica
I20260807 18:45:47.565794 24753 raft_consensus.cc:2229] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:47.566100 24753 raft_consensus.cc:2258] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:47.569481 24753 ts_tablet_manager.cc:1905] T 4e025d896bae43ef8ee1c0ecbb97ea7a P eebf6e8c4e65477a8556b3b35e01975d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:47.573550 24755 tablet_replica.cc:330] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: stopping tablet replica
I20260807 18:45:47.573927 24755 raft_consensus.cc:2229] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:47.574324 24755 raft_consensus.cc:2258] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 18:45:47.577160 24195 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:40477 (error 108)
I20260807 18:45:47.578105 24755 ts_tablet_manager.cc:1905] T 4e025d896bae43ef8ee1c0ecbb97ea7a P 40914e880460437992a8ea4e81e37768: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:47.578389 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24416
I20260807 18:45:47.594455 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24556
I20260807 18:45:47.596220 24721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.595547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:40477 (local address 127.0.0.1:37496)
0807 18:45:47.596031 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.596102 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:40477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397}
I20260807 18:45:47.596462 24723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:47.595919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44253 (local address 127.0.0.1:45870)
0807 18:45:47.596049 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:47.596102 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.194:44253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 18:45:47.596638 24195 catalog_manager.cc:4584] TS 8ddb604b63374cc5831bdde4889963f0 (127.10.174.193:40477): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4e025d896bae43ef8ee1c0ecbb97ea7a: Network error: Client connection negotiation failed: client connection to 127.10.174.193:40477: connect: Connection refused (error 111)
I20260807 18:45:47.602828 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24176
I20260807 18:45:47.611824 10939 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 18:45:47.957616 10939 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 18:45:47.957727 10939 mini_ranger.cc:66] Stopping Ranger...
I20260807 18:45:48.302457 10939 mini_ranger.cc:68] Stopped Ranger
2026-08-07 18:45:48.302 UTC [23208] LOG: received smart shutdown request
2026-08-07 18:45:48.306 UTC [23208] LOG: background worker "logical replication launcher" (PID 23217) exited with exit code 1
2026-08-07 18:45:48.306 UTC [23212] LOG: shutting down
2026-08-07 18:45:48.447 UTC [23208] LOG: database system is shut down
2026-08-07T18:45:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48017 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:45:48 dist-test-slave-07c2 krb5kdc[24765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:45:48 dist-test-slave-07c2 krb5kdc[24765](info): set up 2 sockets
Aug 07 18:45:48 dist-test-slave-07c2 krb5kdc[24765](info): commencing operation
krb5kdc: starting...
W20260807 18:45:49.630067 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:45:49 dist-test-slave-07c2 krb5kdc[24765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:45:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:45:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:45:49.747900 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:44199
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:44199,127.10.174.253:37855,127.10.174.252:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:49.854372 24778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:49.854640 24778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:49.854710 24778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:49.858589 24778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:49.858670 24778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:49.858711 24778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:49.858762 24778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:49.858801 24778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:49.863865 24778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:44199,127.10.174.253:37855,127.10.174.252:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:44199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:49.864807 24778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:49.865746 24778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:49.873523 24784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:49.873523 24783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:49.873529 24786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:49.873906 24778 server_base.cc:1034] running on GCE node
I20260807 18:45:49.874429 24778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:49.875494 24778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:49.876672 24778 hybrid_clock.cc:648] HybridClock initialized: now 1786128349876661 us; error 28 us; skew 500 ppm
Aug 07 18:45:49 dist-test-slave-07c2 krb5kdc[24765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:49.879207 24778 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:49.880048 24778 webserver.cc:460] Webserver started at http://127.10.174.254:45379/ using document root <none> and password file <none>
I20260807 18:45:49.880553 24778 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:49.880637 24778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:49.880863 24778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:49.882786 24778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "937f9d83bf81401a99905b12af0d7469"
format_stamp: "Formatted at 2026-08-07 18:45:49 on dist-test-slave-07c2"
server_key: "3a53ad575242e76d8f73fabb4c1f9d32"
server_key_iv: "ee7cef5c03296ca8deafd0dd3af7373a"
server_key_version: "encryptionkey@0"
I20260807 18:45:49.883401 24778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "937f9d83bf81401a99905b12af0d7469"
format_stamp: "Formatted at 2026-08-07 18:45:49 on dist-test-slave-07c2"
server_key: "3a53ad575242e76d8f73fabb4c1f9d32"
server_key_iv: "ee7cef5c03296ca8deafd0dd3af7373a"
server_key_version: "encryptionkey@0"
I20260807 18:45:49.886708 24778 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:45:49.888964 24794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:49.890040 24778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 18:45:49.890167 24778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "937f9d83bf81401a99905b12af0d7469"
format_stamp: "Formatted at 2026-08-07 18:45:49 on dist-test-slave-07c2"
server_key: "3a53ad575242e76d8f73fabb4c1f9d32"
server_key_iv: "ee7cef5c03296ca8deafd0dd3af7373a"
server_key_version: "encryptionkey@0"
I20260807 18:45:49.890273 24778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:49.902135 24778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:49.904652 24778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:49.904843 24778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:49.911311 24778 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:44199
I20260807 18:45:49.911597 24846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:44199 every 8 connection(s)
I20260807 18:45:49.912171 24778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:49.913509 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24778
I20260807 18:45:49.913650 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:45:49.913987 10939 external_mini_cluster.cc:1428] Setting key 1079877d7868cd47a559d0916635b718
I20260807 18:45:49.915181 24847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:49.918915 24847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.253@KRBTEST.COM" created.
Aug 07 18:45:49 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:49.934420 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:49.921652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36888 (local address 127.10.174.254:44199)
0807 18:45:49.921963 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:49.921973 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:49.922012 (+ 39us) server_negotiation.cc:407] Connection header received
0807 18:45:49.922524 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:49.922528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:49.922689 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:49.922835 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:49.923671 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:49.924774 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:49.926386 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:49.927024 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:49.927202 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:49.929653 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:49.929663 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:49.929677 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:49.929710 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:49.931733 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:49.932203 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:49.932209 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:49.932211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:49.932348 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:49.932650 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:49.932655 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:49.932657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:49.933122 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:49.933261 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:49.933577 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 18:45:49.933753 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":137,"server-negotiator.queue_time_us":187,"spinlock_wait_cycles":2432,"thread_start_us":89,"threads_started":1}
I20260807 18:45:49.934420 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:49.920840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:44199 (local address 127.0.0.1:36888)
0807 18:45:49.921286 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:49.921345 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:49.922199 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:49.922861 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:49.922864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:49.923253 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:49.923530 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:49.923543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:49.924932 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:49.924937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:49.926244 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:49.926260 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:49.927176 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:49.927179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:49.927328 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:49.927922 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:49.927937 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:49.929501 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:49.931853 (+ 2352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:49.931862 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:49.931869 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:49.932091 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:49.932444 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:49.932446 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:49.932447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:49.932553 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:49.933228 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:49.933232 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:49.933341 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 18:45:49.933468 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 18:45:49.933698 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":23,"thread_start_us":122,"threads_started":1}
I20260807 18:45:49.936743 24847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:45:49.937376 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:49.937150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32868)
0807 18:45:49.937255 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:49.937326 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 18:45:49.937593 24795 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
I20260807 18:45:49.938397 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:49.938184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32870)
0807 18:45:49.938287 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:49.938339 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 18:45:49.938553 24847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:37855: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab.
Entry for principal kudu/127.10.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab.
I20260807 18:45:49.939718 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:37855
--webserver_interface=127.10.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab
--principal=kudu/127.10.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:44199,127.10.174.253:37855,127.10.174.252:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:49.987773 24847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } attempt: 1
I20260807 18:45:49.988721 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:49.988392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32882)
0807 18:45:49.988555 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:49.988622 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 18:45:49.989462 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:49.989245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32884)
0807 18:45:49.989351 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:49.989403 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 18:45:49.989593 24847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:37855: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
W20260807 18:45:50.049185 24854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:50.049494 24854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:50.049571 24854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:50.053563 24854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:50.053638 24854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:50.053676 24854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:50.053725 24854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:50.053776 24854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:50.057746 24847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } attempt: 2
I20260807 18:45:50.058537 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.058247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32898)
0807 18:45:50.058394 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.058463 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 18:45:50.059187 24854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:44199,127.10.174.253:37855,127.10.174.252:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab
--principal=kudu/127.10.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:37855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:50.059276 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.059052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32906)
0807 18:45:50.059167 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.059217 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 18:45:50.059479 24847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:37855: Network error: Client connection negotiation failed: client connection to 127.10.174.253:37855: connect: Connection refused (error 111)
I20260807 18:45:50.060242 24854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:50.061164 24854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:50.069067 24859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:50.069092 24862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:50.069067 24860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:50.069303 24854 server_base.cc:1034] running on GCE node
I20260807 18:45:50.069895 24854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:50.070843 24854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:50.072014 24854 hybrid_clock.cc:648] HybridClock initialized: now 1786128350071999 us; error 26 us; skew 500 ppm
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:50.074568 24854 init.cc:377] Logged in from keytab as kudu/127.10.174.253@KRBTEST.COM (short username kudu)
I20260807 18:45:50.075505 24854 webserver.cc:460] Webserver started at http://127.10.174.253:34277/ using document root <none> and password file <none>
I20260807 18:45:50.076006 24854 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:50.076092 24854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:50.076301 24854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:50.078186 24854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data/instance:
uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf"
format_stamp: "Formatted at 2026-08-07 18:45:50 on dist-test-slave-07c2"
server_key: "a2b31d94953956186ed62e7bdc6d7d97"
server_key_iv: "982a83e793b9e3ec697632f80109ad8b"
server_key_version: "encryptionkey@0"
I20260807 18:45:50.078720 24854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal/instance:
uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf"
format_stamp: "Formatted at 2026-08-07 18:45:50 on dist-test-slave-07c2"
server_key: "a2b31d94953956186ed62e7bdc6d7d97"
server_key_iv: "982a83e793b9e3ec697632f80109ad8b"
server_key_version: "encryptionkey@0"
I20260807 18:45:50.082090 24854 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 18:45:50.084287 24869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:50.085449 24854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:45:50.085578 24854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal
uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf"
format_stamp: "Formatted at 2026-08-07 18:45:50 on dist-test-slave-07c2"
server_key: "a2b31d94953956186ed62e7bdc6d7d97"
server_key_iv: "982a83e793b9e3ec697632f80109ad8b"
server_key_version: "encryptionkey@0"
I20260807 18:45:50.085680 24854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:50.106958 24854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:50.109807 24854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:50.110004 24854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:50.116958 24854 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.253:37855
I20260807 18:45:50.117231 24924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.253:37855 every 8 connection(s)
I20260807 18:45:50.117960 24854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
I20260807 18:45:50.120572 24925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:50.124087 24925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:45:50.125615 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24854
I20260807 18:45:50.125767 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-1/wal/instance
I20260807 18:45:50.126082 10939 external_mini_cluster.cc:1428] Setting key 889937bebf137c3244fc0451f64757bd
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.252@KRBTEST.COM" created.
I20260807 18:45:50.139066 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.125937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36890 (local address 127.10.174.254:44199)
0807 18:45:50.126099 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.126104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.126986 (+ 882us) server_negotiation.cc:407] Connection header received
0807 18:45:50.128313 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.128319 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.128380 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.128476 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.129535 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.130429 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.131924 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.132171 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.132255 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.135026 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.135031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.135034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.135066 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.136912 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.137442 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.137445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.137446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.137519 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.137892 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.137898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.137903 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.138134 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.138214 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.138850 (+ 636us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.138947 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:45:50.140118 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.126320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:44199 (local address 127.0.0.1:36890)
0807 18:45:50.126808 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.126867 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.128082 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.128629 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.128635 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.128955 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.129393 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.129405 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.130555 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.130558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.131798 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.131813 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.132332 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.132339 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.132581 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.133230 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.133252 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.134863 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.137074 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.137083 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.137105 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.137357 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.137600 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.137617 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.137622 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.137786 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.138239 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.138247 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.138571 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.138795 (+ 224us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.139146 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":108,"threads_started":1}
I20260807 18:45:50.141544 24925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:45:50.150641 24847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab.
Entry for principal kudu/127.10.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab.
I20260807 18:45:50.151889 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.142087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32922)
0807 18:45:50.142205 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.142219 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.142293 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.142891 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.142893 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.143068 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.143135 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.143140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.144128 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.144134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.144651 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.144665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.145237 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.145241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.145332 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.145827 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.145838 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.148084 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.150060 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.150063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.150064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.150258 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.150574 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.150576 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.150578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.150663 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.151175 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.151178 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.151271 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.151486 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.151640 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 18:45:50.152539 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:39419
--webserver_interface=127.10.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab
--principal=kudu/127.10.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:44199,127.10.174.253:37855,127.10.174.252:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:50.152650 24930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.142249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32922 (local address 127.10.174.253:37855)
0807 18:45:50.142579 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.142588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.142605 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:45:50.142636 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.142640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.142780 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.142911 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.143238 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.144018 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.144768 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.145122 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.145241 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.148230 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.148239 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.148256 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.148277 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.149953 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.150377 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.150381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.150382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.150483 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.150772 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.150775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.150776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.151055 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.151198 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.152250 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.152454 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":231,"thread_start_us":158,"threads_started":1}
I20260807 18:45:50.154639 24925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:45:50.155369 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.155101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59888)
0807 18:45:50.155201 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.155278 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 18:45:50.156119 24873 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:45:50.157052 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.156813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59900)
0807 18:45:50.156944 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.156998 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 18:45:50.157219 24925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39419: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
I20260807 18:45:50.160740 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.151158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32928)
0807 18:45:50.151394 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.151410 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.151496 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.151783 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.151788 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.151993 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.152123 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.152131 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.153222 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.153227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.153990 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.154001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.154559 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.154562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.154666 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.155312 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.155329 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.156873 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.159233 (+ 2360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.159235 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.159246 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.159527 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.159840 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.159842 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.159844 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.159917 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.160381 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.160383 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.160461 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.160532 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.160631 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260807 18:45:50.161029 24931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.151196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32928 (local address 127.10.174.253:37855)
0807 18:45:50.151521 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.151533 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.151594 (+ 61us) server_negotiation.cc:407] Connection header received
0807 18:45:50.151632 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.151634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.151672 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.151767 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.152227 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.153097 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.154128 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.154437 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.154546 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.157006 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.157013 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.157019 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.157048 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.159124 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.159635 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.159641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.159645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.159742 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.160016 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.160021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.160025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.160287 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.160402 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.160646 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.160783 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":263,"thread_start_us":114,"threads_started":1}
I20260807 18:45:50.161666 24847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:45:50.162444 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.162131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59904)
0807 18:45:50.162281 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.162350 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 18:45:50.163213 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.162894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59916)
0807 18:45:50.163066 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.163129 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260807 18:45:50.163393 24847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39419: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
I20260807 18:45:50.194583 24847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } attempt: 1
I20260807 18:45:50.195499 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.195106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59926)
0807 18:45:50.195307 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.195394 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 18:45:50.196352 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.196119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59936)
0807 18:45:50.196229 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.196286 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 18:45:50.196492 24847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39419: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
I20260807 18:45:50.206526 24925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } attempt: 1
I20260807 18:45:50.207273 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.207018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59946)
0807 18:45:50.207140 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.207198 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 18:45:50.207983 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.207786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59956)
0807 18:45:50.207886 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.207931 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 18:45:50.208154 24925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39419: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
W20260807 18:45:50.264362 24932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:50.264585 24932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:50.264622 24932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:50.268807 24932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:50.268857 24932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:50.268877 24932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:50.268893 24932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:50.268942 24932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:50.271636 24847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } attempt: 2
I20260807 18:45:50.272418 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.272112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59964)
0807 18:45:50.272267 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.272333 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 18:45:50.273083 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.272881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59976)
0807 18:45:50.272977 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.273025 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 18:45:50.273222 24847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39419: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
I20260807 18:45:50.274688 24932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:44199,127.10.174.253:37855,127.10.174.252:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab
--principal=kudu/127.10.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:39419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:50.275674 24932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:50.276293 24925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } attempt: 2
I20260807 18:45:50.276722 24932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:45:50.276993 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.276709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:59988)
0807 18:45:50.276848 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.276928 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 18:45:50.277612 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.277416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:60000)
0807 18:45:50.277515 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.277565 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 18:45:50.277727 24925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39419: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39419: connect: Connection refused (error 111)
W20260807 18:45:50.284653 24939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:50.284653 24938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:50.284735 24941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:50.285025 24932 server_base.cc:1034] running on GCE node
I20260807 18:45:50.285547 24932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:50.286495 24932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:50.287643 24932 hybrid_clock.cc:648] HybridClock initialized: now 1786128350287611 us; error 43 us; skew 500 ppm
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:50.290357 24932 init.cc:377] Logged in from keytab as kudu/127.10.174.252@KRBTEST.COM (short username kudu)
I20260807 18:45:50.291208 24932 webserver.cc:460] Webserver started at http://127.10.174.252:43231/ using document root <none> and password file <none>
I20260807 18:45:50.291749 24932 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:50.291836 24932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:50.292047 24932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:50.293936 24932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data/instance:
uuid: "f5a6524f059044519cf2c3928e3836d3"
format_stamp: "Formatted at 2026-08-07 18:45:50 on dist-test-slave-07c2"
server_key: "f1a882064b447b301d17e2a4f12ebbec"
server_key_iv: "78fcec5d918e13c6d13a11d8758b8173"
server_key_version: "encryptionkey@0"
I20260807 18:45:50.294510 24932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal/instance:
uuid: "f5a6524f059044519cf2c3928e3836d3"
format_stamp: "Formatted at 2026-08-07 18:45:50 on dist-test-slave-07c2"
server_key: "f1a882064b447b301d17e2a4f12ebbec"
server_key_iv: "78fcec5d918e13c6d13a11d8758b8173"
server_key_version: "encryptionkey@0"
I20260807 18:45:50.297940 24932 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 18:45:50.300148 24948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:50.301257 24932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:45:50.301386 24932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal
uuid: "f5a6524f059044519cf2c3928e3836d3"
format_stamp: "Formatted at 2026-08-07 18:45:50 on dist-test-slave-07c2"
server_key: "f1a882064b447b301d17e2a4f12ebbec"
server_key_iv: "78fcec5d918e13c6d13a11d8758b8173"
server_key_version: "encryptionkey@0"
I20260807 18:45:50.301486 24932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:50.346263 24932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:50.349135 24932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:50.349334 24932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:50.356133 24932 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.252:39419
I20260807 18:45:50.356423 25001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.252:39419 every 8 connection(s)
I20260807 18:45:50.357021 24932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
I20260807 18:45:50.359603 25002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:50.360404 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 24932
I20260807 18:45:50.360543 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786128190976416-10939-0/minicluster-data/master-2/wal/instance
I20260807 18:45:50.360838 10939 external_mini_cluster.cc:1428] Setting key db82a82c616e511a373dc88edb0491c6
I20260807 18:45:50.363943 25002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:45:50.368882 24925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } attempt: 3
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:50.372398 24847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } attempt: 3
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:45:50.376283 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.365779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36896 (local address 127.10.174.254:44199)
0807 18:45:50.365906 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.365910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.366114 (+ 204us) server_negotiation.cc:407] Connection header received
0807 18:45:50.366264 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.366267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.366340 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.366425 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.367007 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.367590 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.368682 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.369069 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.369178 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.372253 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.372257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.372259 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.372286 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.374194 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.374680 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.374685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.374689 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.374778 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.375093 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.375098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.375103 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.375370 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.375446 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.376018 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.376122 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 18:45:50.376744 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.362100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.10.174.252:39419)
0807 18:45:50.362530 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.362549 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.362597 (+ 48us) server_negotiation.cc:407] Connection header received
0807 18:45:50.363419 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.363443 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.363827 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.364164 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.364932 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.366239 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.367140 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.367653 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.367812 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.370536 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.370542 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.370553 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.370578 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.373330 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.373802 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.373808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.373813 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.373919 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.374191 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.374196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.374197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.374660 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.374844 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.375576 (+ 732us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.375843 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":103,"threads_started":1}
I20260807 18:45:50.376894 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.365626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:44199 (local address 127.0.0.1:36896)
0807 18:45:50.365990 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.366034 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.366149 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.366470 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.366474 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.366782 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.366891 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.366897 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.367696 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.367701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.368542 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.368552 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.369355 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.369359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.369484 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.370448 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.370472 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.372040 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.374295 (+ 2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.374301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.374305 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.374557 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.374894 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.374897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.374899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.374982 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.375640 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.375645 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.375791 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.376452 (+ 661us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.376674 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":3,"thread_start_us":105,"threads_started":1}
I20260807 18:45:50.378322 25002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:45:50.381016 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.369347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60022 (local address 127.10.174.252:39419)
0807 18:45:50.369631 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.369639 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.369663 (+ 24us) server_negotiation.cc:407] Connection header received
0807 18:45:50.369697 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.369702 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.369756 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.369842 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.370350 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.371033 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.371896 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.372269 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.372370 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.374711 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.374715 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.374718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.374744 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.378954 (+ 4210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.379477 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.379483 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.379487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.379574 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.379960 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.379963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.379964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.380165 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.380564 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.380677 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.380800 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":124,"threads_started":1}
I20260807 18:45:50.381560 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.369321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:60022)
0807 18:45:50.369522 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.369538 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.369620 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.369894 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.369900 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.370097 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.370230 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.370239 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.371141 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.371145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.371781 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.371790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.372408 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.372414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.372500 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.373032 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.373050 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.374555 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.379063 (+ 4508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.379067 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.379069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.379356 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.379730 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.379734 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.379736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.379839 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.380276 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.380280 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.380382 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.380477 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.381408 (+ 931us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":766}
I20260807 18:45:50.384239 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.372775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:60026)
0807 18:45:50.372963 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.372976 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.373047 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.374573 (+ 1526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.374577 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.374768 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.374876 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.374884 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.376619 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.376623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.377442 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.377453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.378044 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.378048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.378128 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.378548 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.378562 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.380084 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.382549 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.382552 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.382554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.382793 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.383121 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.383124 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.383125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.383221 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.383707 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.383713 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.383816 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.383901 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.384061 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:45:50.385180 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.372821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60026 (local address 127.10.174.252:39419)
0807 18:45:50.374323 (+ 1502us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.374336 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.374349 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:45:50.374383 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.374386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.374427 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.375004 (+ 577us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.375122 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.376477 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.377580 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.377912 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.378016 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.380240 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.380246 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.380252 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.380275 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.382431 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.382926 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.382929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.382931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.383010 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.383360 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.383363 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.383365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.383582 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.384776 (+ 1194us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.384851 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.384956 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":586,"thread_start_us":100,"threads_started":1}
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:50.385542 24925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: Bootstrap starting.
I20260807 18:45:50.388221 24925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:50.389138 24925 log.cc:824] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:50.389343 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.379719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36900 (local address 127.10.174.254:44199)
0807 18:45:50.379842 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.379848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.380007 (+ 159us) server_negotiation.cc:407] Connection header received
0807 18:45:50.380172 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.380176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.380214 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.380264 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.381047 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.381678 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.382940 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.383249 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.383338 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.386038 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.386042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.386044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.386067 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.387337 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.387818 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.387824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.387828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.387920 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.388222 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.388228 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.388232 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.388449 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.388678 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.389045 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.389164 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:45:50.390591 24847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: Bootstrap starting.
I20260807 18:45:50.390841 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.378766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:37855 (local address 127.0.0.1:32936)
0807 18:45:50.379426 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.379441 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.379551 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.379903 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.379906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.380069 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.380194 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.380201 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.381818 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.381822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.382650 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.382659 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.383375 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.383378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.383505 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.383903 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.383914 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.385347 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.389153 (+ 3806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.389156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.389157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.389446 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.389775 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.389777 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.389779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.389879 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.390410 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.390413 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.390479 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.390578 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.390696 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":4}
I20260807 18:45:50.390882 24931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.378873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32936 (local address 127.10.174.253:37855)
0807 18:45:50.379091 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.379097 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.379490 (+ 393us) server_negotiation.cc:407] Connection header received
0807 18:45:50.379659 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.379665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.379709 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.379760 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.380389 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.381193 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.382784 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.383125 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.383191 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.385504 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.385507 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.385510 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.385533 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.389025 (+ 3492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.389562 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.389566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.389568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.389652 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.389994 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.389997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.389999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.390260 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.390332 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.390628 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.390732 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":128}
I20260807 18:45:50.391702 25002 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:45:50.393131 24847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:50.393469 24925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: No bootstrap required, opened a new log
I20260807 18:45:50.393929 24847 log.cc:824] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:50.395769 24847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: No bootstrap required, opened a new log
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:45:50.397480 24925 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.397691 24925 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:50.397754 24925 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8601a5f107a43c7b0f1e42a6a14c9bf, State: Initialized, Role: FOLLOWER
I20260807 18:45:50.398228 24925 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.399477 24925 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 18:45:50 dist-test-slave-07c2 krb5kdc[24765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:45:50.399995 24847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.400285 24847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:50.400398 24847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937f9d83bf81401a99905b12af0d7469, State: Initialized, Role: FOLLOWER
I20260807 18:45:50.400902 24847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.402278 24847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:50.403817 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.392114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39419 (local address 127.0.0.1:60042)
0807 18:45:50.392403 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:50.392416 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:50.392475 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:50.394550 (+ 2075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:50.394553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:50.394723 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:50.394805 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.394811 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.396049 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.396054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.396956 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:50.396967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.397607 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.397611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:50.397695 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.398138 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:50.398388 (+ 250us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:50.400135 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:50.402392 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.402397 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.402402 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.402623 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.402906 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:50.402910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:50.402911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:50.402992 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:50.403417 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:50.403421 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:50.403491 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 18:45:50.403563 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 18:45:50.403675 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260807 18:45:50.404398 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.392183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60042 (local address 127.10.174.252:39419)
0807 18:45:50.394355 (+ 2172us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.394359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.394372 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:45:50.394402 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.394404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.394439 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.394891 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.394946 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.395929 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.397091 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.397481 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.400267 (+ 2786us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.400370 (+ 103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.400373 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.400376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.400396 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.402287 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.402733 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.402736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.402737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.402815 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.403093 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.403096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.403098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.403320 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.404074 (+ 754us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.404142 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.404258 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2105}
W20260807 18:45:50.405179 25023 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:45:50.405256 25023 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:45:50.403060 24854 master_runner.cc:186] Error getting master registration for 127.10.174.254:44199: OK, instance_id { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" instance_seqno: 1786128349909515 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:45:50.406222 24854 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 18:45:50.406179 24800 tablet.cc:2369] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:45:50.407239 25036 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:45:50.407512 25036 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:45:50.407708 25021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.408447 25021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.401692 24931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.390914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.10.174.253:37855)
0807 18:45:50.391025 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.391029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.391091 (+ 62us) server_negotiation.cc:407] Connection header received
0807 18:45:50.391198 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.391201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.391235 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.392279 (+ 1044us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.392990 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.393634 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.394738 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.395053 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.395121 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.397916 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.397920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.397925 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.397958 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.399649 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.400147 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.400150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.400152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.400239 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.400564 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.400570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.400577 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.400819 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.401013 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.401425 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.401538 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:45:50.410115 25002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: Bootstrap starting.
I20260807 18:45:50.411448 25011 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.411571 25011 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.412503 25002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:50.413110 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:45:50.413321 25002 log.cc:824] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:50.412276 24778 master_runner.cc:186] Error getting master registration for 127.10.174.252:39419: OK, instance_id { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" instance_seqno: 1786128350354238 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:45:50.415668 24778 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:45:50.417693 25002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: No bootstrap required, opened a new log
I20260807 18:45:50.422451 25002 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.422684 25002 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:50.422747 25002 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5a6524f059044519cf2c3928e3836d3, State: Initialized, Role: FOLLOWER
I20260807 18:45:50.423213 25002 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.424569 25002 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:50.428772 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.415541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36912 (local address 127.10.174.254:44199)
0807 18:45:50.415647 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.415651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.417136 (+ 1485us) server_negotiation.cc:407] Connection header received
0807 18:45:50.417333 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.417336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.417385 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.417437 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.418409 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.419180 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.420409 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.420720 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.420792 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.422660 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.422664 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.422667 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.422691 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.424338 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.427359 (+ 3021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.427362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.427364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.427448 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.427760 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.427764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.427765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.427971 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.428093 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.428485 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.428616 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:45:50.432066 24932 master_runner.cc:263] No leader master found from master f5a6524f059044519cf2c3928e3836d3
I20260807 18:45:50.432129 24932 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:45:50.432199 25046 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.432341 25046 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.435056 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.416155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60052 (local address 127.10.174.252:39419)
0807 18:45:50.416259 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.416263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.421438 (+ 5175us) server_negotiation.cc:407] Connection header received
0807 18:45:50.422998 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.423002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.423079 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.423521 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.425379 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.426143 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.427314 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.427639 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.427723 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.431587 (+ 3864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.431591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.431594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.431617 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.433345 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.433801 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.433804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.433806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.433884 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.434171 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.434174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.434176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.434370 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.434486 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.434812 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.434917 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 18:45:50.438244 25058 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:45:50.438323 25058 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:45:50.443881 24931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:50.416566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32964 (local address 127.10.174.253:37855)
0807 18:45:50.416668 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:50.416672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:50.423207 (+ 6535us) server_negotiation.cc:407] Connection header received
0807 18:45:50.423405 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:50.423409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:50.423461 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:50.423515 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:50.425583 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.426314 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.428729 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:50.429053 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:50.429136 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:50.440114 (+ 10978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:50.440118 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:50.440120 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:50.440147 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:50.441783 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.442268 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.442271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.442273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.442354 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:50.442634 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:50.442637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:50.442639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:50.442833 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:50.442942 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:50.443618 (+ 676us) server_negotiation.cc:299] Negotiation successful
0807 18:45:50.443732 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 18:45:50.473672 25021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:45:50.473842 25021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.474848 25021 leader_election.cc:288] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8601a5f107a43c7b0f1e42a6a14c9bf (127.10.174.253:37855), f5a6524f059044519cf2c3928e3836d3 (127.10.174.252:39419)
I20260807 18:45:50.475603 24975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "937f9d83bf81401a99905b12af0d7469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a6524f059044519cf2c3928e3836d3" is_pre_election: true
I20260807 18:45:50.475899 24975 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937f9d83bf81401a99905b12af0d7469 in term 0.
I20260807 18:45:50.476413 24797 leader_election.cc:302] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937f9d83bf81401a99905b12af0d7469, f5a6524f059044519cf2c3928e3836d3; no voters:
I20260807 18:45:50.477088 24898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "937f9d83bf81401a99905b12af0d7469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" is_pre_election: true
I20260807 18:45:50.477351 24898 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937f9d83bf81401a99905b12af0d7469 in term 0.
I20260807 18:45:50.477943 25021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:45:50.478018 25021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:45:50.478057 25021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:50.479439 25021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.479764 25021 leader_election.cc:288] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [CANDIDATE]: Term 1 election: Requested vote from peers d8601a5f107a43c7b0f1e42a6a14c9bf (127.10.174.253:37855), f5a6524f059044519cf2c3928e3836d3 (127.10.174.252:39419)
I20260807 18:45:50.480177 24975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "937f9d83bf81401a99905b12af0d7469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a6524f059044519cf2c3928e3836d3"
I20260807 18:45:50.480291 24975 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:50.481984 24975 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937f9d83bf81401a99905b12af0d7469 in term 1.
I20260807 18:45:50.482869 24797 leader_election.cc:302] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937f9d83bf81401a99905b12af0d7469, f5a6524f059044519cf2c3928e3836d3; no voters:
I20260807 18:45:50.483354 24898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "937f9d83bf81401a99905b12af0d7469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf"
I20260807 18:45:50.483466 24898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:50.484670 24898 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937f9d83bf81401a99905b12af0d7469 in term 1.
I20260807 18:45:50.487272 25021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:50.487534 25021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [term 1 LEADER]: Becoming Leader. State: Replica: 937f9d83bf81401a99905b12af0d7469, State: Running, Role: LEADER
I20260807 18:45:50.487851 25021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } }
I20260807 18:45:50.489730 25021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 937f9d83bf81401a99905b12af0d7469. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.489888 25021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:50.490391 25062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:50.491401 25062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:50.500442 24975 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [term 1 FOLLOWER]: Refusing update from remote peer 937f9d83bf81401a99905b12af0d7469: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:50.501138 25060 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:50.505275 25046 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 937f9d83bf81401a99905b12af0d7469. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.505383 25046 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.506510 24898 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [term 1 FOLLOWER]: Refusing update from remote peer 937f9d83bf81401a99905b12af0d7469: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:50.509044 25060 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:50.512986 25011 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 937f9d83bf81401a99905b12af0d7469. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.513127 25011 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.516661 25060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.516781 25060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:50.518133 25046 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.518260 25046 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.518693 25063 mvcc.cc:205] Tried to move back new op lower bound from 7315981723643015168 to 7315981723601608704. Current Snapshot: MvccSnapshot[applied={T|T < 7315981723643015168}]
I20260807 18:45:50.519951 25064 mvcc.cc:205] Tried to move back new op lower bound from 7315981723643015168 to 7315981723601608704. Current Snapshot: MvccSnapshot[applied={T|T < 7315981723643015168}]
I20260807 18:45:50.524693 25021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.524818 25021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469 [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:50.525337 25011 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "937f9d83bf81401a99905b12af0d7469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937f9d83bf81401a99905b12af0d7469" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 44199 } } peers { permanent_uuid: "d8601a5f107a43c7b0f1e42a6a14c9bf" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 37855 } } peers { permanent_uuid: "f5a6524f059044519cf2c3928e3836d3" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39419 } } }
I20260807 18:45:50.525449 25011 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:45:50.525799 25066 mvcc.cc:205] Tried to move back new op lower bound from 7315981723643015168 to 7315981723601608704. Current Snapshot: MvccSnapshot[applied={T|T < 7315981723643015168}]
I20260807 18:45:50.526358 25062 catalog_manager.cc:1347] Generated new cluster ID: de17311a5beb40139075e10c9fd94880
I20260807 18:45:50.526417 25062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:45:50.563329 25062 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:45:50.567199 25062 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:45:50.579272 25062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 937f9d83bf81401a99905b12af0d7469: Generated new TSK 0
I20260807 18:45:50.580083 25062 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:45:51.406889 25023 catalog_manager.cc:1259] Loaded cluster ID: de17311a5beb40139075e10c9fd94880
I20260807 18:45:51.406985 25023 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: loading cluster ID for follower catalog manager: success
I20260807 18:45:51.409394 25023 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: acquiring CA information for follower catalog manager: success
I20260807 18:45:51.410763 25023 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d8601a5f107a43c7b0f1e42a6a14c9bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:45:51.439507 25058 catalog_manager.cc:1259] Loaded cluster ID: de17311a5beb40139075e10c9fd94880
I20260807 18:45:51.439568 25058 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: loading cluster ID for follower catalog manager: success
I20260807 18:45:51.441792 25058 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: acquiring CA information for follower catalog manager: success
I20260807 18:45:51.442940 25058 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5a6524f059044519cf2c3928e3836d3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:45:51.640954 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24778
I20260807 18:45:51.648605 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24854
I20260807 18:45:51.654838 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 24932
2026-08-07T18:45:51Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3082 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:45:51 dist-test-slave-07c2 krb5kdc[25079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:45:51 dist-test-slave-07c2 krb5kdc[25079](info): set up 2 sockets
Aug 07 18:45:51 dist-test-slave-07c2 krb5kdc[25079](info): commencing operation
krb5kdc: starting...
W20260807 18:45:52.701733 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:45:52 dist-test-slave-07c2 krb5kdc[25079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:45:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:45:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:45:52.819995 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:41139
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:41387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:41139
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:52.924834 25092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:52.925097 25092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:52.925182 25092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:52.929134 25092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:52.929203 25092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:52.929239 25092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:52.929289 25092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:52.929327 25092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:52.934435 25092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:41387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:41139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:41139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:52.935429 25092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:52.936364 25092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:52.944065 25098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:52.944103 25097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:52.944082 25100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:52.944159 25092 server_base.cc:1034] running on GCE node
I20260807 18:45:52.944857 25092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:52.945788 25092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:52.946942 25092 hybrid_clock.cc:648] HybridClock initialized: now 1786128352946923 us; error 31 us; skew 500 ppm
Aug 07 18:45:52 dist-test-slave-07c2 krb5kdc[25079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128352, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:52.949599 25092 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:52.950398 25092 webserver.cc:460] Webserver started at http://127.10.174.254:44689/ using document root <none> and password file <none>
I20260807 18:45:52.950867 25092 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:52.950923 25092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:52.951074 25092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:52.952935 25092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "191dfea1164246a28bc76741c06f13bd"
format_stamp: "Formatted at 2026-08-07 18:45:52 on dist-test-slave-07c2"
server_key: "62c4bcbad83038f32a0bf15712ecd170"
server_key_iv: "6aff4cecb1610fa8fb0c4fe08c9790a7"
server_key_version: "encryptionkey@0"
I20260807 18:45:52.953469 25092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "191dfea1164246a28bc76741c06f13bd"
format_stamp: "Formatted at 2026-08-07 18:45:52 on dist-test-slave-07c2"
server_key: "62c4bcbad83038f32a0bf15712ecd170"
server_key_iv: "6aff4cecb1610fa8fb0c4fe08c9790a7"
server_key_version: "encryptionkey@0"
I20260807 18:45:52.956938 25092 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:45:52.959019 25107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:52.960156 25092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:52.960273 25092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "191dfea1164246a28bc76741c06f13bd"
format_stamp: "Formatted at 2026-08-07 18:45:52 on dist-test-slave-07c2"
server_key: "62c4bcbad83038f32a0bf15712ecd170"
server_key_iv: "6aff4cecb1610fa8fb0c4fe08c9790a7"
server_key_version: "encryptionkey@0"
I20260807 18:45:52.960366 25092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:52.979525 25092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:52.982380 25092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:52.982569 25092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:52.989287 25092 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:41139
I20260807 18:45:52.989318 25159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:41139 every 8 connection(s)
I20260807 18:45:52.990119 25092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:52.992695 25160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:52.995513 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25092
I20260807 18:45:52.995652 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:45:52.995986 10939 external_mini_cluster.cc:1428] Setting key 48ee9690f21a12d90021db7d38c6fb5a
I20260807 18:45:52.998546 25160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd: Bootstrap starting.
I20260807 18:45:53.001118 25160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:53.001943 25160 log.cc:824] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:53.004123 25160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd: No bootstrap required, opened a new log
Aug 07 18:45:53 dist-test-slave-07c2 krb5kdc[25079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:53.008019 25160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "191dfea1164246a28bc76741c06f13bd" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41139 } }
I20260807 18:45:53.008313 25160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:53.008389 25160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191dfea1164246a28bc76741c06f13bd, State: Initialized, Role: FOLLOWER
I20260807 18:45:53.008855 25160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "191dfea1164246a28bc76741c06f13bd" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41139 } }
I20260807 18:45:53.009030 25160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:45:53.009102 25160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:45:53.009223 25160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:53.010438 25160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "191dfea1164246a28bc76741c06f13bd" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41139 } }
I20260807 18:45:53.010794 25160 leader_election.cc:302] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 191dfea1164246a28bc76741c06f13bd; no voters:
I20260807 18:45:53.011119 25160 leader_election.cc:288] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:45:53.011231 25165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:53.011477 25165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [term 1 LEADER]: Becoming Leader. State: Replica: 191dfea1164246a28bc76741c06f13bd, State: Running, Role: LEADER
I20260807 18:45:53.011698 25163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:52.997264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54356 (local address 127.10.174.254:41139)
0807 18:45:52.997670 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:52.997688 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:52.997784 (+ 96us) server_negotiation.cc:407] Connection header received
0807 18:45:52.998609 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:52.998632 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:52.999018 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:52.999374 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:53.000052 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:53.001536 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:53.002466 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:53.003079 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:53.003243 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:53.005726 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:53.005733 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:53.005750 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:53.005785 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:53.008493 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:53.008960 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:53.008966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:53.008973 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:53.009123 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:53.009433 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:53.009439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:53.009444 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:53.009953 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:53.010164 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:53.010356 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 18:45:53.010672 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":98,"threads_started":1}
I20260807 18:45:53.011780 25165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "191dfea1164246a28bc76741c06f13bd" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41139 } }
I20260807 18:45:53.012398 25160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:53.012892 25165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "191dfea1164246a28bc76741c06f13bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "191dfea1164246a28bc76741c06f13bd" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41139 } } }
I20260807 18:45:53.012929 25168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 191dfea1164246a28bc76741c06f13bd. Latest consensus state: current_term: 1 leader_uuid: "191dfea1164246a28bc76741c06f13bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "191dfea1164246a28bc76741c06f13bd" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 41139 } } }
I20260807 18:45:53.012997 25165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:53.013022 25168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:53.014969 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:45:53.015496 25170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:53.018404 25170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:53.023726 25170 catalog_manager.cc:1347] Generated new cluster ID: ea3ef4ae759746a6b056ec10819be33a
I20260807 18:45:53.023797 25170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:45:53.036846 25170 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:45:53.037708 25170 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:45:53.047124 25170 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 191dfea1164246a28bc76741c06f13bd: Generated new TSK 0
I20260807 18:45:53.047782 25170 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:45:53.070430 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25092
2026-08-07T18:45:53Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1415 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:45:53 dist-test-slave-07c2 krb5kdc[25188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:45:53 dist-test-slave-07c2 krb5kdc[25188](info): set up 2 sockets
Aug 07 18:45:53 dist-test-slave-07c2 krb5kdc[25188](info): commencing operation
krb5kdc: starting...
W20260807 18:45:54.122422 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:45:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:45:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:45:54.245849 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38161
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38161
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:54.354424 25201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:54.354661 25201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:54.354700 25201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:54.358529 25201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:54.358580 25201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:54.358599 25201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:54.358615 25201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:54.358630 25201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:54.363551 25201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:54.364409 25201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:54.365310 25201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:54.373485 25209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:54.373494 25206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:54.373733 25201 server_base.cc:1034] running on GCE node
W20260807 18:45:54.373493 25207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:54.374325 25201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:54.375393 25201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:54.376585 25201 hybrid_clock.cc:648] HybridClock initialized: now 1786128354376568 us; error 29 us; skew 500 ppm
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:54.384148 25201 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:54.384954 25201 webserver.cc:460] Webserver started at http://127.10.174.254:44673/ using document root <none> and password file <none>
I20260807 18:45:54.385452 25201 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:54.385509 25201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:54.385660 25201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:54.387667 25201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "09b5e9519cb94982bb65dbc6584d18ae"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "6f6f78ef9ee0cdce03563158155e599e"
server_key_iv: "d122bc4c04ca54b76778a13b64f4af09"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.388180 25201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "09b5e9519cb94982bb65dbc6584d18ae"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "6f6f78ef9ee0cdce03563158155e599e"
server_key_iv: "d122bc4c04ca54b76778a13b64f4af09"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.391692 25201 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:45:54.393831 25217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.394956 25201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:54.395051 25201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "09b5e9519cb94982bb65dbc6584d18ae"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "6f6f78ef9ee0cdce03563158155e599e"
server_key_iv: "d122bc4c04ca54b76778a13b64f4af09"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.395128 25201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:54.413142 25201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:54.416072 25201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:54.416209 25201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:54.423113 25201 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38161
I20260807 18:45:54.423429 25269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38161 every 8 connection(s)
I20260807 18:45:54.424044 25201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:54.426510 25270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:54.431581 25270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap starting.
I20260807 18:45:54.432691 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25201
I20260807 18:45:54.432832 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:45:54.433138 10939 external_mini_cluster.cc:1428] Setting key 454552c5b4cae7e4297c1b723f7473b4
I20260807 18:45:54.434453 25270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:54.435154 25270 log.cc:824] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:54.436906 25270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: No bootstrap required, opened a new log
I20260807 18:45:54.439741 25270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:54.439962 25270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:54.440023 25270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b5e9519cb94982bb65dbc6584d18ae, State: Initialized, Role: FOLLOWER
I20260807 18:45:54.440546 25270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:54.440677 25270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:45:54.440762 25270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:45:54.440857 25270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:54.441658 25270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:54.441991 25270 leader_election.cc:302] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09b5e9519cb94982bb65dbc6584d18ae; no voters:
I20260807 18:45:54.442315 25270 leader_election.cc:288] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:45:54.442662 25276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:54.442879 25276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 LEADER]: Becoming Leader. State: Replica: 09b5e9519cb94982bb65dbc6584d18ae, State: Running, Role: LEADER
I20260807 18:45:54.443192 25276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:54.443570 25270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:54.445062 25277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b5e9519cb94982bb65dbc6584d18ae. Latest consensus state: current_term: 1 leader_uuid: "09b5e9519cb94982bb65dbc6584d18ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } } }
I20260807 18:45:54.445183 25277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:54.445538 25275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09b5e9519cb94982bb65dbc6584d18ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } } }
I20260807 18:45:54.446867 25275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:54.447906 25273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:54.434167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39816 (local address 127.10.174.254:38161)
0807 18:45:54.434538 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:54.434574 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:54.434619 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:45:54.435203 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:54.435217 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:54.435579 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:54.435889 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:54.436659 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.437649 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.438498 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.439529 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.439692 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:54.442420 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:54.442427 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:54.442443 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:54.442472 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:54.444458 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:54.444991 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:54.444997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:54.445004 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:54.445166 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:54.445518 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:54.445521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:54.445523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:54.446066 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:54.446302 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:54.446639 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 18:45:54.446934 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":123,"threads_started":1}
W20260807 18:45:54.448714 25290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:45:54.448800 25290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:45:54.448907 25288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:54.449726 25288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:54.454397 25288 catalog_manager.cc:1347] Generated new cluster ID: 2b2737013c9141dbaf5b284a5fe20a6c
I20260807 18:45:54.454456 25288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:45:54.462177 25288 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:45:54.463260 25288 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:45:54.467465 25288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Generated new TSK 0
I20260807 18:45:54.468024 25288 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:45:54.498843 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38161
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:54.609177 25296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:54.609443 25296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:54.609520 25296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:54.613430 25296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:54.613508 25296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:54.613595 25296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:45:54.618572 25296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:54.619585 25296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:54.620568 25296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:54.629859 25304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:54.629940 25296 server_base.cc:1034] running on GCE node
W20260807 18:45:54.629859 25302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:54.629856 25301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:54.630524 25296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:54.631217 25296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:54.632373 25296 hybrid_clock.cc:648] HybridClock initialized: now 1786128354632348 us; error 32 us; skew 500 ppm
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:54.635201 25296 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:45:54.636013 25296 webserver.cc:460] Webserver started at http://127.10.174.193:34855/ using document root <none> and password file <none>
I20260807 18:45:54.636548 25296 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:54.636608 25296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:54.636857 25296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:54.638777 25296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "68408cea23b34cf7a8856d263b1e6a86"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "ed75e9978e709aec0962f1aef34c3a7e"
server_key_iv: "1549c3bb3994b5f90504a402dd1c235a"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.639392 25296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "68408cea23b34cf7a8856d263b1e6a86"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "ed75e9978e709aec0962f1aef34c3a7e"
server_key_iv: "1549c3bb3994b5f90504a402dd1c235a"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.642838 25296 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:45:54.645476 25311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.646624 25296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:54.646749 25296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "68408cea23b34cf7a8856d263b1e6a86"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "ed75e9978e709aec0962f1aef34c3a7e"
server_key_iv: "1549c3bb3994b5f90504a402dd1c235a"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.646847 25296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:54.671656 25296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:54.674324 25296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:54.674520 25296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:54.675084 25296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:54.675912 25296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:54.675958 25296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.676026 25296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:54.676059 25296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.684391 25296 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:33887
I20260807 18:45:54.684413 25428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:33887 every 8 connection(s)
I20260807 18:45:54.685240 25296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:45:54.685937 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25296
I20260807 18:45:54.686092 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:45:54.686435 10939 external_mini_cluster.cc:1428] Setting key c75fc3bda45ab0c62348db84d9661054
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:45:54.699923 25273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:54.687103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:35137 (local address 127.10.174.254:38161)
0807 18:45:54.687268 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:54.687273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:54.688165 (+ 892us) server_negotiation.cc:407] Connection header received
0807 18:45:54.689496 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:54.689500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:54.689551 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:54.689628 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:54.691156 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.692025 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.693154 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.693575 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.693752 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:54.696142 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:54.696149 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:54.696155 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:54.696187 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:54.697738 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:54.698258 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:54.698265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:54.698268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:54.698352 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:54.698687 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:54.698692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:54.698694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:54.698874 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:54.698981 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:54.699629 (+ 648us) server_negotiation.cc:299] Negotiation successful
0807 18:45:54.699759 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 18:45:54.700685 25431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:54.687566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:35137)
0807 18:45:54.688031 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:54.688071 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:54.689299 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:54.689782 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:54.689788 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:54.690321 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:54.690994 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:54.691014 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.692179 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.692183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:54.693031 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:54.693039 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.693756 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.693759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:54.693895 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:54.694509 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:54.694523 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:54.695976 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:54.697855 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:54.697859 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:54.697869 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:54.698109 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:54.698448 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:54.698452 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:54.698454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:54.698590 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:54.698980 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:54.698986 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:54.699335 (+ 349us) client_negotiation.cc:769] Sending connection context
0807 18:45:54.699585 (+ 250us) client_negotiation.cc:240] Negotiation successful
0807 18:45:54.699913 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":151,"threads_started":1}
I20260807 18:45:54.702054 25429 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38161
I20260807 18:45:54.702301 25429 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:54.702872 25429 heartbeater.cc:511] Master 127.10.174.254:38161 requested a full tablet report, sending...
I20260807 18:45:54.704411 25234 ts_manager.cc:194] Registered new tserver with Master: 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887)
I20260807 18:45:54.705492 25234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:35137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:45:54.715778 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38161
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:54.821158 25434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:54.821450 25434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:54.821522 25434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:54.825418 25434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:54.825465 25434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:54.825567 25434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:45:54.830536 25434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:54.831439 25434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:54.832329 25434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:54.841015 25442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:54.841060 25439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:54.841060 25440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:54.841307 25434 server_base.cc:1034] running on GCE node
I20260807 18:45:54.841785 25434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:54.842344 25434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:54.843495 25434 hybrid_clock.cc:648] HybridClock initialized: now 1786128354843469 us; error 37 us; skew 500 ppm
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:54.846163 25434 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:45:54.846987 25434 webserver.cc:460] Webserver started at http://127.10.174.194:42735/ using document root <none> and password file <none>
I20260807 18:45:54.847558 25434 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:54.847620 25434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:54.847846 25434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:54.849757 25434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "db429d9d495b4d36910e1bfcb138b8da"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "680441cf579fc9e03e7c718876e1d53e"
server_key_iv: "2c3493be39b4b013ddcfb1974839d8ed"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.850287 25434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "db429d9d495b4d36910e1bfcb138b8da"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "680441cf579fc9e03e7c718876e1d53e"
server_key_iv: "2c3493be39b4b013ddcfb1974839d8ed"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.853814 25434 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:45:54.856076 25449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.857200 25434 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:45:54.857318 25434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "db429d9d495b4d36910e1bfcb138b8da"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "680441cf579fc9e03e7c718876e1d53e"
server_key_iv: "2c3493be39b4b013ddcfb1974839d8ed"
server_key_version: "encryptionkey@0"
I20260807 18:45:54.857424 25434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:54.876341 25434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:54.878850 25434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:54.879040 25434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:54.879639 25434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:54.880405 25434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:54.880450 25434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.880514 25434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:54.880553 25434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:54.889036 25434 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44937
I20260807 18:45:54.889063 25570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44937 every 8 connection(s)
I20260807 18:45:54.889840 25434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:45:54.891556 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25434
I20260807 18:45:54.891698 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:45:54.892023 10939 external_mini_cluster.cc:1428] Setting key 422e6be57db5e3ca14565ba25ccbff14
Aug 07 18:45:54 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128354, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:45:54.904258 25273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:54.891497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:36229 (local address 127.10.174.254:38161)
0807 18:45:54.891627 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:54.891634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:54.892615 (+ 981us) server_negotiation.cc:407] Connection header received
0807 18:45:54.894228 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:54.894231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:54.894274 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:54.894344 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:54.895861 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.896380 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.897519 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.897965 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.898099 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:54.900705 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:54.900709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:54.900714 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:54.900745 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:54.902363 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:54.902828 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:54.902831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:54.902832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:54.902907 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:54.903246 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:54.903253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:54.903254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:54.903481 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:54.903559 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:54.904026 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 18:45:54.904131 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
I20260807 18:45:54.905076 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:54.891944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:36229)
0807 18:45:54.892436 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:54.892490 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:54.894014 (+ 1524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:54.894532 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:54.894543 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:54.895042 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:54.895717 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:54.895739 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.896507 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.896510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:54.897347 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:54.897356 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:54.898109 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:54.898112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:54.898238 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:54.898842 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:54.898858 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:54.900530 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:54.902474 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:54.902478 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:54.902489 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:54.902722 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:54.903008 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:54.903011 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:54.903012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:54.903132 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:54.903569 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:54.903573 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:54.903776 (+ 203us) client_negotiation.cc:769] Sending connection context
0807 18:45:54.903955 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 18:45:54.904217 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":142,"threads_started":1}
I20260807 18:45:54.906206 25571 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38161
I20260807 18:45:54.906427 25571 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:54.906872 25571 heartbeater.cc:511] Master 127.10.174.254:38161 requested a full tablet report, sending...
I20260807 18:45:54.907862 25234 ts_manager.cc:194] Registered new tserver with Master: db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
I20260807 18:45:54.908406 25234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:36229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:45:54.920074 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38161
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:55.026435 25576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:55.026672 25576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:55.026755 25576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:55.030747 25576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:55.030803 25576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:55.030918 25576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:45:55.036089 25576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:55.037099 25576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:55.038080 25576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:55.047340 25582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:55.047379 25581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:55.047454 25576 server_base.cc:1034] running on GCE node
W20260807 18:45:55.047374 25584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:55.048013 25576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:55.048604 25576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:55.049788 25576 hybrid_clock.cc:648] HybridClock initialized: now 1786128355049775 us; error 23 us; skew 500 ppm
Aug 07 18:45:55 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128355, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:55.052459 25576 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:45:55.053292 25576 webserver.cc:460] Webserver started at http://127.10.174.195:39587/ using document root <none> and password file <none>
I20260807 18:45:55.053820 25576 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:55.053910 25576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:55.054131 25576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:45:55.056414 25576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "f46869b37cdf4c8c91a47dbda2ef2b96"
format_stamp: "Formatted at 2026-08-07 18:45:55 on dist-test-slave-07c2"
server_key: "342e850ac1719dad315702221412840e"
server_key_iv: "1ca82361b92ef31e2924a7bcb87629e2"
server_key_version: "encryptionkey@0"
I20260807 18:45:55.057097 25576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "f46869b37cdf4c8c91a47dbda2ef2b96"
format_stamp: "Formatted at 2026-08-07 18:45:55 on dist-test-slave-07c2"
server_key: "342e850ac1719dad315702221412840e"
server_key_iv: "1ca82361b92ef31e2924a7bcb87629e2"
server_key_version: "encryptionkey@0"
I20260807 18:45:55.061268 25576 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:45:55.063503 25591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:55.064628 25576 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:45:55.064754 25576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "f46869b37cdf4c8c91a47dbda2ef2b96"
format_stamp: "Formatted at 2026-08-07 18:45:55 on dist-test-slave-07c2"
server_key: "342e850ac1719dad315702221412840e"
server_key_iv: "1ca82361b92ef31e2924a7bcb87629e2"
server_key_version: "encryptionkey@0"
I20260807 18:45:55.064853 25576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:55.085619 25576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:55.088339 25576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:55.088544 25576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:55.089116 25576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:55.089942 25576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:55.089996 25576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:55.090073 25576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:55.090112 25576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:55.099025 25576 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:35531
I20260807 18:45:55.099071 25709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:35531 every 8 connection(s)
I20260807 18:45:55.099887 25576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:45:55.105515 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25576
I20260807 18:45:55.105633 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:45:55.105950 10939 external_mini_cluster.cc:1428] Setting key 1e04af20eb5bb7871b7d28083e38ae24
Aug 07 18:45:55 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128355, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:55.112912 25273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.101514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:39757 (local address 127.10.174.254:38161)
0807 18:45:55.101648 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.101652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.102409 (+ 757us) server_negotiation.cc:407] Connection header received
0807 18:45:55.103795 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.103798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.103856 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.103961 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:55.105043 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.105570 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.107154 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.107472 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.107575 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.109923 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:55.109926 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:55.109928 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:55.109952 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:55.111168 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:55.111689 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:55.111692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:55.111693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:55.111770 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:55.112052 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:55.112054 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:55.112055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:55.112219 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:55.112295 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.112703 (+ 408us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.112794 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:45:55.113693 25712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.101855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:39757)
0807 18:45:55.102269 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.102309 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:55.103598 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:55.104123 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:55.104130 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:55.104461 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:55.104902 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.104914 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.105752 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.105757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.107021 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.107034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.107613 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.107616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.107746 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.108399 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:55.108414 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:55.109784 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:55.111324 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:55.111336 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:55.111346 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:55.111587 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:55.111851 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:55.111853 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:55.111854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:55.111974 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:55.112304 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:55.112309 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:55.112506 (+ 197us) client_negotiation.cc:769] Sending connection context
0807 18:45:55.112649 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 18:45:55.112902 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260807 18:45:55.114756 25710 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38161
I20260807 18:45:55.114967 25710 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:55.115453 25710 heartbeater.cc:511] Master 127.10.174.254:38161 requested a full tablet report, sending...
I20260807 18:45:55.116387 25234 ts_manager.cc:194] Registered new tserver with Master: f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531)
I20260807 18:45:55.116926 25234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:39757
I20260807 18:45:55.119601 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:45:55.128038 25273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.121403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39832 (local address 127.10.174.254:38161)
0807 18:45:55.121521 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.121524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.121734 (+ 210us) server_negotiation.cc:407] Connection header received
0807 18:45:55.121822 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.121824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.121859 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.121921 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:55.122533 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.123001 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.123826 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.124024 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.124100 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.125270 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:55.125273 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:55.125275 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:55.125296 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:55.126477 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:55.126915 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:55.126917 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:55.126918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:55.126985 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:55.127232 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:55.127234 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:55.127235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:55.127503 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:55.127607 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.127847 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.127935 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:45:55.130573 25234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:45:55.133468 25234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:45:55.147895 25721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.142169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33887 (local address 127.0.0.1:44566)
0807 18:45:55.142926 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.142940 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:55.143088 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:55.143767 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:55.143770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:55.143785 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:55.143879 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.143890 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.145493 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.145499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.146503 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.146514 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.147364 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.147367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.147482 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.147522 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 18:45:55.147630 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 18:45:55.147742 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"mutex_wait_us":2,"thread_start_us":86,"threads_started":1}
I20260807 18:45:55.148226 25724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.141772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50804 (local address 127.10.174.194:44937)
0807 18:45:55.142419 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.142429 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.142457 (+ 28us) server_negotiation.cc:407] Connection header received
0807 18:45:55.142873 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.142883 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.143104 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.143271 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:55.143884 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.145158 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.146699 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.147498 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.147608 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.147707 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.147814 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.147922 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":111,"threads_started":1}
I20260807 18:45:55.148315 25726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.142373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44566 (local address 127.10.174.193:33887)
0807 18:45:55.142787 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.142798 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.143017 (+ 219us) server_negotiation.cc:407] Connection header received
0807 18:45:55.143246 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.143258 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.143458 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.143609 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:55.144003 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.145205 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.146636 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.147213 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.147370 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.147500 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.148105 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.148181 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":126,"threads_started":1}
I20260807 18:45:55.148449 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.141619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57142 (local address 127.10.174.195:35531)
0807 18:45:55.142227 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.142240 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.142601 (+ 361us) server_negotiation.cc:407] Connection header received
0807 18:45:55.142940 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.142945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.143121 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.143259 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:55.143965 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.144851 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.146511 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.147391 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.147510 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.147653 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.148198 (+ 545us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.148303 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":167,"threads_started":1}
I20260807 18:45:55.147955 25722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.141500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44937 (local address 127.0.0.1:50804)
0807 18:45:55.142280 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.142327 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:55.142446 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:55.143475 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:55.143481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:55.143535 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:55.143767 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.143774 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.145292 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.145295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.146594 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.146606 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.147602 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.147608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.147691 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.147710 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 18:45:55.147787 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 18:45:55.147840 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":151,"spinlock_wait_cycles":3200,"thread_start_us":85,"threads_started":1}
I20260807 18:45:55.148105 25725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.141502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:35531 (local address 127.0.0.1:57142)
0807 18:45:55.142513 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.142528 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:55.142667 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:55.143475 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:55.143481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:55.143535 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:55.143815 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.143844 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.145047 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.145050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.146376 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.146387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.147720 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.147727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.147824 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.147845 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:45:55.147915 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 18:45:55.147978 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"mutex_wait_us":125,"spinlock_wait_cycles":39424,"thread_start_us":104,"threads_started":1}
I20260807 18:45:55.151122 25360 tablet_service.cc:1467] Processing CreateTablet for tablet d9a4b8fd886a4b05acf921fc9b380e04 (DEFAULT_TABLE table=test-table [id=02f801db90284a3b9b4eb926f14eaddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:55.151353 25500 tablet_service.cc:1467] Processing CreateTablet for tablet d9a4b8fd886a4b05acf921fc9b380e04 (DEFAULT_TABLE table=test-table [id=02f801db90284a3b9b4eb926f14eaddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:55.151683 25641 tablet_service.cc:1467] Processing CreateTablet for tablet d9a4b8fd886a4b05acf921fc9b380e04 (DEFAULT_TABLE table=test-table [id=02f801db90284a3b9b4eb926f14eaddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:55.152201 25360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a4b8fd886a4b05acf921fc9b380e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:55.152374 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a4b8fd886a4b05acf921fc9b380e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:55.152558 25641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a4b8fd886a4b05acf921fc9b380e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:55.158030 25727 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap starting.
I20260807 18:45:55.159830 25728 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Bootstrap starting.
I20260807 18:45:55.159830 25729 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Bootstrap starting.
I20260807 18:45:55.160341 25727 tablet_bootstrap.cc:654] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:55.161434 25727 log.cc:824] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:55.162359 25728 tablet_bootstrap.cc:654] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:55.162359 25729 tablet_bootstrap.cc:654] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:55.163178 25728 log.cc:824] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:55.163177 25729 log.cc:824] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:55.163781 25727 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: No bootstrap required, opened a new log
I20260807 18:45:55.163976 25727 ts_tablet_manager.cc:1397] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:45:55.165036 25729 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: No bootstrap required, opened a new log
I20260807 18:45:55.165270 25729 ts_tablet_manager.cc:1397] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:45:55.165371 25728 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: No bootstrap required, opened a new log
I20260807 18:45:55.165539 25728 ts_tablet_manager.cc:1397] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:45:55.166854 25727 raft_consensus.cc:348] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.167084 25727 raft_consensus.cc:374] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:55.167172 25727 raft_consensus.cc:729] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68408cea23b34cf7a8856d263b1e6a86, State: Initialized, Role: FOLLOWER
I20260807 18:45:55.167640 25727 consensus_queue.cc:260] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.168242 25429 heartbeater.cc:503] Master 127.10.174.254:38161 was elected leader, sending a full tablet report...
I20260807 18:45:55.168640 25727 ts_tablet_manager.cc:1428] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:45:55.169225 25728 raft_consensus.cc:348] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.169525 25728 raft_consensus.cc:374] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:55.169620 25728 raft_consensus.cc:729] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f46869b37cdf4c8c91a47dbda2ef2b96, State: Initialized, Role: FOLLOWER
I20260807 18:45:55.169464 25729 raft_consensus.cc:348] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.170022 25729 raft_consensus.cc:374] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:55.170115 25729 raft_consensus.cc:729] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db429d9d495b4d36910e1bfcb138b8da, State: Initialized, Role: FOLLOWER
I20260807 18:45:55.170078 25728 consensus_queue.cc:260] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.170591 25729 consensus_queue.cc:260] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.170733 25710 heartbeater.cc:503] Master 127.10.174.254:38161 was elected leader, sending a full tablet report...
I20260807 18:45:55.171007 25728 ts_tablet_manager.cc:1428] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:45:55.171593 25729 ts_tablet_manager.cc:1428] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:45:55.171952 25571 heartbeater.cc:503] Master 127.10.174.254:38161 was elected leader, sending a full tablet report...
W20260807 18:45:55.186529 25430 tablet.cc:2369] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:45:55.350819 25711 tablet.cc:2369] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:45:55.390978 25572 tablet.cc:2369] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:45:55.518716 25733 raft_consensus.cc:482] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:45:55.518929 25733 raft_consensus.cc:504] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.520153 25733 leader_election.cc:288] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
I20260807 18:45:55.524158 25723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.520579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:58953 (local address 127.10.174.195:35531)
0807 18:45:55.520733 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.520737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.521116 (+ 379us) server_negotiation.cc:407] Connection header received
0807 18:45:55.521236 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.521238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.521291 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.521372 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:55.521655 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.522148 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.523166 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.523568 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.523658 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.523738 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.523956 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.524022 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:45:55.524186 25736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.520446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44937 (local address 127.10.174.193:50645)
0807 18:45:55.520826 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.520838 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:55.520938 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:55.521228 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:55.521231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:55.521248 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:55.521386 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.521393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.522175 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.522181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.522990 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.522998 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.523763 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.523768 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.523849 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.523866 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 18:45:55.523957 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 18:45:55.524023 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":88,"threads_started":1}
I20260807 18:45:55.524181 25724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.520576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:50645 (local address 127.10.174.194:44937)
0807 18:45:55.520743 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.520747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.520925 (+ 178us) server_negotiation.cc:407] Connection header received
0807 18:45:55.521033 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.521039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.521105 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.521199 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:55.521509 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.522060 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.523121 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.523597 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.523735 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.523791 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.523990 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.524059 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:45:55.524196 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.520446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:35531 (local address 127.10.174.193:58953)
0807 18:45:55.520992 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.521006 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:55.521127 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:55.521395 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:55.521397 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:55.521411 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:55.521549 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.521555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.522259 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.522261 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.523020 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:55.523028 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.523697 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.523700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:55.523816 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.523840 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:45:55.523909 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 18:45:55.523998 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":58,"thread_start_us":142,"threads_started":1}
I20260807 18:45:55.524809 25521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a4b8fd886a4b05acf921fc9b380e04" candidate_uuid: "68408cea23b34cf7a8856d263b1e6a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db429d9d495b4d36910e1bfcb138b8da" is_pre_election: true
I20260807 18:45:55.524951 25661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a4b8fd886a4b05acf921fc9b380e04" candidate_uuid: "68408cea23b34cf7a8856d263b1e6a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" is_pre_election: true
I20260807 18:45:55.525125 25521 raft_consensus.cc:2454] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68408cea23b34cf7a8856d263b1e6a86 in term 0.
I20260807 18:45:55.525211 25661 raft_consensus.cc:2454] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68408cea23b34cf7a8856d263b1e6a86 in term 0.
I20260807 18:45:55.525609 25315 leader_election.cc:302] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86, db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96; no voters:
I20260807 18:45:55.525871 25733 raft_consensus.cc:2781] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:45:55.525945 25733 raft_consensus.cc:482] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:45:55.525976 25733 raft_consensus.cc:3037] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:55.527269 25733 raft_consensus.cc:504] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.527697 25733 leader_election.cc:288] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 1 election: Requested vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
I20260807 18:45:55.528064 25661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a4b8fd886a4b05acf921fc9b380e04" candidate_uuid: "68408cea23b34cf7a8856d263b1e6a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96"
I20260807 18:45:55.528067 25521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9a4b8fd886a4b05acf921fc9b380e04" candidate_uuid: "68408cea23b34cf7a8856d263b1e6a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db429d9d495b4d36910e1bfcb138b8da"
I20260807 18:45:55.528190 25521 raft_consensus.cc:3037] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:55.528190 25661 raft_consensus.cc:3037] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:55.529497 25521 raft_consensus.cc:2454] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68408cea23b34cf7a8856d263b1e6a86 in term 1.
I20260807 18:45:55.529497 25661 raft_consensus.cc:2454] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68408cea23b34cf7a8856d263b1e6a86 in term 1.
I20260807 18:45:55.529799 25315 leader_election.cc:302] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86, db429d9d495b4d36910e1bfcb138b8da; no voters:
I20260807 18:45:55.529970 25733 raft_consensus.cc:2781] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:55.530184 25733 raft_consensus.cc:686] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 LEADER]: Becoming Leader. State: Replica: 68408cea23b34cf7a8856d263b1e6a86, State: Running, Role: LEADER
I20260807 18:45:55.530508 25733 consensus_queue.cc:237] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:55.533604 25233 catalog_manager.cc:5495] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "68408cea23b34cf7a8856d263b1e6a86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } health_report { overall_health: HEALTHY } } }
I20260807 18:45:55.595321 25726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.592004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44572 (local address 127.10.174.193:33887)
0807 18:45:55.592197 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:55.592201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:55.592215 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:45:55.592290 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:55.592292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:55.592347 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:55.592441 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:45:55.592660 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.593147 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.593981 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:55.594190 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:55.594267 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:55.594517 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:45:55.594904 (+ 387us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:45:55.594993 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:55.595043 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 18:45:55.595088 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 18:45:55.601130 25521 raft_consensus.cc:1261] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Refusing update from remote peer 68408cea23b34cf7a8856d263b1e6a86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:55.601130 25661 raft_consensus.cc:1261] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Refusing update from remote peer 68408cea23b34cf7a8856d263b1e6a86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:55.601855 25738 consensus_queue.cc:1035] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:55.602028 25733 consensus_queue.cc:1035] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:55.610527 25742 mvcc.cc:205] Tried to move back new op lower bound from 7315981744535289856 to 7315981744255401984. Current Snapshot: MvccSnapshot[applied={T|T < 7315981744535289856}]
I20260807 18:45:55.611256 25741 mvcc.cc:205] Tried to move back new op lower bound from 7315981744535289856 to 7315981744255401984. Current Snapshot: MvccSnapshot[applied={T|T < 7315981744535289856 or (T in {7315981744535289856})}]
I20260807 18:45:55.616894 25233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:45:55.617061 25233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:45:55.619436 25233 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Sending DeleteTablet for 3 replicas of tablet d9a4b8fd886a4b05acf921fc9b380e04
I20260807 18:45:55.620275 25500 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a4b8fd886a4b05acf921fc9b380e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:55 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:50804
I20260807 18:45:55.620285 25641 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a4b8fd886a4b05acf921fc9b380e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:55 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:57142
I20260807 18:45:55.620494 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25296
I20260807 18:45:55.622510 25751 tablet_replica.cc:330] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: stopping tablet replica
I20260807 18:45:55.622781 25751 raft_consensus.cc:2229] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:55.623050 25751 raft_consensus.cc:2258] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:55.623399 25752 tablet_replica.cc:330] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: stopping tablet replica
I20260807 18:45:55.623675 25752 raft_consensus.cc:2229] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:55.623942 25752 raft_consensus.cc:2258] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:55.624588 25751 ts_tablet_manager.cc:1905] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:55.625051 25752 ts_tablet_manager.cc:1905] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:55.627228 25752 ts_tablet_manager.cc:1918] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:45:55.627357 25752 log.cc:1196] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/d9a4b8fd886a4b05acf921fc9b380e04
I20260807 18:45:55.627648 25752 ts_tablet_manager.cc:1939] T d9a4b8fd886a4b05acf921fc9b380e04 P db429d9d495b4d36910e1bfcb138b8da: Deleting consensus metadata
I20260807 18:45:55.628093 25751 ts_tablet_manager.cc:1918] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:45:55.628202 25751 log.cc:1196] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/d9a4b8fd886a4b05acf921fc9b380e04
I20260807 18:45:55.628620 25751 ts_tablet_manager.cc:1939] T d9a4b8fd886a4b05acf921fc9b380e04 P f46869b37cdf4c8c91a47dbda2ef2b96: Deleting consensus metadata
I20260807 18:45:55.628801 25221 catalog_manager.cc:4841] TS db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): tablet d9a4b8fd886a4b05acf921fc9b380e04 (table test-table [id=02f801db90284a3b9b4eb926f14eaddf]) successfully deleted
W20260807 18:45:55.629724 25220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:33887 (error 108)
I20260807 18:45:55.629765 25219 catalog_manager.cc:4841] TS f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): tablet d9a4b8fd886a4b05acf921fc9b380e04 (table test-table [id=02f801db90284a3b9b4eb926f14eaddf]) successfully deleted
I20260807 18:45:55.629968 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25434
I20260807 18:45:55.631233 25721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:55.630948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33887 (local address 127.0.0.1:44580)
0807 18:45:55.631074 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:55.631146 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 18:45:55.631407 25220 catalog_manager.cc:4584] TS 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d9a4b8fd886a4b05acf921fc9b380e04: Network error: Client connection negotiation failed: client connection to 127.10.174.193:33887: connect: Connection refused (error 111)
I20260807 18:45:55.637099 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25576
I20260807 18:45:55.643231 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25201
I20260807 18:45:55.650488 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38161
--webserver_interface=127.10.174.254
--webserver_port=44673
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:55.757339 25754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:55.757582 25754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:55.757645 25754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:55.761581 25754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:55.761628 25754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:55.761647 25754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:55.761701 25754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:55.761731 25754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:55.766731 25754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=44673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:55.767675 25754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:55.768635 25754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:55.781837 25760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:55.781883 25764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:55.782069 25754 server_base.cc:1034] running on GCE node
W20260807 18:45:55.781837 25761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:55.782734 25754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:55.783819 25754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:55.784974 25754 hybrid_clock.cc:648] HybridClock initialized: now 1786128355784955 us; error 31 us; skew 500 ppm
Aug 07 18:45:55 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128355, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:55.787670 25754 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:55.788553 25754 webserver.cc:460] Webserver started at http://127.10.174.254:44673/ using document root <none> and password file <none>
I20260807 18:45:55.789103 25754 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:55.789193 25754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:55.792840 25754 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:45:55.794879 25771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:55.796068 25754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:55.796201 25754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "09b5e9519cb94982bb65dbc6584d18ae"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "6f6f78ef9ee0cdce03563158155e599e"
server_key_iv: "d122bc4c04ca54b76778a13b64f4af09"
server_key_version: "encryptionkey@0"
I20260807 18:45:55.796761 25754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:55.811825 25754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:55.814309 25754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:55.814495 25754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:55.821519 25754 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38161
I20260807 18:45:55.821821 25823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38161 every 8 connection(s)
I20260807 18:45:55.822656 25754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:55.826344 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25754
I20260807 18:45:55.826719 25824 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:45:55.826773 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:33887
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:38161
--webserver_port=34855
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:55.828428 25824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap starting.
I20260807 18:45:55.845659 25824 log.cc:824] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:55.854038 25824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:45:55.854395 25824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap complete.
I20260807 18:45:55.858395 25824 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:55.858789 25824 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b5e9519cb94982bb65dbc6584d18ae, State: Initialized, Role: FOLLOWER
I20260807 18:45:55.859335 25824 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:55.859489 25824 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:45:55.859562 25824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:45:55.859655 25824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:45:55.861506 25824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:55.861829 25824 leader_election.cc:302] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09b5e9519cb94982bb65dbc6584d18ae; no voters:
I20260807 18:45:55.862174 25824 leader_election.cc:288] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:45:55.862243 25828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:45:55.862457 25828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 LEADER]: Becoming Leader. State: Replica: 09b5e9519cb94982bb65dbc6584d18ae, State: Running, Role: LEADER
I20260807 18:45:55.862793 25828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:55.863370 25824 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:55.863687 25828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b5e9519cb94982bb65dbc6584d18ae. Latest consensus state: current_term: 2 leader_uuid: "09b5e9519cb94982bb65dbc6584d18ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } } }
I20260807 18:45:55.864315 25829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "09b5e9519cb94982bb65dbc6584d18ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } } }
I20260807 18:45:55.864446 25828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:55.864727 25829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:55.865337 25838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:55.869939 25838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:55.870600 25838 catalog_manager.cc:1259] Loaded cluster ID: 2b2737013c9141dbaf5b284a5fe20a6c
I20260807 18:45:55.870702 25838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:45:55.872514 25838 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 18:45:55.877007 25838 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 18:45:55.882125 25838 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:45:55.882827 25838 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Loaded TSK: 0
I20260807 18:45:55.884028 25838 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 18:45:55.941147 25826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:55.941373 25826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:55.941418 25826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:55.945395 25826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:55.945442 25826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:55.945497 25826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:45:55.950519 25826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:33887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=34855
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:55.951465 25826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:55.952365 25826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:55.961114 25857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:55.961256 25853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:55.961112 25854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:55.962086 25826 server_base.cc:1034] running on GCE node
I20260807 18:45:55.962551 25826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:55.963323 25826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:55.964563 25826 hybrid_clock.cc:648] HybridClock initialized: now 1786128355964529 us; error 62 us; skew 500 ppm
Aug 07 18:45:55 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128355, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:55.967494 25826 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:45:55.968319 25826 webserver.cc:460] Webserver started at http://127.10.174.193:34855/ using document root <none> and password file <none>
I20260807 18:45:55.968859 25826 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:55.968931 25826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:55.972641 25826 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:45:55.975015 25864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:55.976292 25826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:45:55.976433 25826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "68408cea23b34cf7a8856d263b1e6a86"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "ed75e9978e709aec0962f1aef34c3a7e"
server_key_iv: "1549c3bb3994b5f90504a402dd1c235a"
server_key_version: "encryptionkey@0"
I20260807 18:45:55.976977 25826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:56.007566 25826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:56.010524 25826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:56.010747 25826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:56.011370 25826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:56.012458 25871 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 18:45:56.016722 25826 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 18:45:56.016816 25826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260807 18:45:56.016897 25826 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 18:45:56.018494 25826 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 18:45:56.018565 25826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 18:45:56.018824 25871 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap starting.
I20260807 18:45:56.029013 25826 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:33887
I20260807 18:45:56.029101 25979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:33887 every 8 connection(s)
I20260807 18:45:56.029982 25826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:45:56.033864 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25826
I20260807 18:45:56.034299 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:44937
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:38161
--webserver_port=42735
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:56.039235 25871 log.cc:824] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128355, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:56.046783 25984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.032257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:50453 (local address 127.10.174.254:38161)
0807 18:45:56.032796 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.032814 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.032862 (+ 48us) server_negotiation.cc:407] Connection header received
0807 18:45:56.034033 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.034047 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.034439 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.034831 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:56.036355 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.037337 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.038479 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.038952 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.039134 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.041830 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:56.041835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:56.041847 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:56.041876 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:56.043688 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.044231 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.044236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.044240 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.044362 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.044700 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.044705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.044706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.045041 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:56.045186 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.045689 (+ 503us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.045946 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":144,"threads_started":1}
I20260807 18:45:56.046801 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.032184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:50453)
0807 18:45:56.032654 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.032705 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.033502 (+ 797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.034889 (+ 1387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.034901 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.035460 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:56.036111 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.036134 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.037510 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.037513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.038351 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.038360 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.039106 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.039110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.039347 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.040012 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:56.040031 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:56.041629 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:56.043831 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:56.043837 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:56.043850 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:56.044101 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:56.044461 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:56.044465 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:56.044467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:56.044605 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:56.045159 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:56.045165 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:56.045399 (+ 234us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.045576 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.045915 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":139,"threads_started":1}
I20260807 18:45:56.049204 25981 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38161
I20260807 18:45:56.049304 25871 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:45:56.049425 25981 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:56.049703 25871 tablet_bootstrap.cc:492] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap complete.
I20260807 18:45:56.049890 25981 heartbeater.cc:511] Master 127.10.174.254:38161 requested a full tablet report, sending...
I20260807 18:45:56.051155 25871 ts_tablet_manager.cc:1397] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Time spent bootstrapping tablet: real 0.033s user 0.024s sys 0.004s
I20260807 18:45:56.052100 25788 ts_manager.cc:194] Registered new tserver with Master: 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887)
I20260807 18:45:56.053946 25871 raft_consensus.cc:348] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.054554 25871 raft_consensus.cc:729] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68408cea23b34cf7a8856d263b1e6a86, State: Initialized, Role: FOLLOWER
I20260807 18:45:56.055115 25871 consensus_queue.cc:260] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.055317 25788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:50453
I20260807 18:45:56.056206 25871 ts_tablet_manager.cc:1428] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260807 18:45:56.057427 25981 heartbeater.cc:503] Master 127.10.174.254:38161 was elected leader, sending a full tablet report...
I20260807 18:45:56.062743 25987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.054607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33887 (local address 127.0.0.1:44584)
0807 18:45:56.055944 (+ 1337us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.055987 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.056251 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.057995 (+ 1744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.058003 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.058035 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:56.058175 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.058182 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.059540 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.059543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.061033 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.061044 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.062218 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.062221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.062339 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.062384 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.062509 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.062620 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1191,"thread_start_us":123,"threads_started":1}
I20260807 18:45:56.062743 25988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.055316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44584 (local address 127.10.174.193:33887)
0807 18:45:56.055686 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.055696 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.056156 (+ 460us) server_negotiation.cc:407] Connection header received
0807 18:45:56.057654 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.057659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.057824 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.057984 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:56.058315 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.059398 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.061213 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.062082 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.062226 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.062337 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.062535 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.062619 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":107,"threads_started":1}
I20260807 18:45:56.063726 25914 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a4b8fd886a4b05acf921fc9b380e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:55 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:44584
I20260807 18:45:56.064538 25990 tablet_replica.cc:330] stopping tablet replica
I20260807 18:45:56.064828 25990 raft_consensus.cc:2229] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:56.065075 25990 raft_consensus.cc:2258] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:56.066025 25990 ts_tablet_manager.cc:1905] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:56.069350 25990 ts_tablet_manager.cc:1918] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:45:56.069427 25990 log.cc:1196] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/d9a4b8fd886a4b05acf921fc9b380e04
I20260807 18:45:56.069720 25990 ts_tablet_manager.cc:1939] T d9a4b8fd886a4b05acf921fc9b380e04 P 68408cea23b34cf7a8856d263b1e6a86: Deleting consensus metadata
I20260807 18:45:56.071183 25774 catalog_manager.cc:4841] TS 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887): tablet d9a4b8fd886a4b05acf921fc9b380e04 (table test-table [id=02f801db90284a3b9b4eb926f14eaddf]) successfully deleted
W20260807 18:45:56.150697 25985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:56.150967 25985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:56.151041 25985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:56.155004 25985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:56.155090 25985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:56.155197 25985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:45:56.160280 25985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:44937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=42735
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:56.161203 25985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:56.162125 25985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:56.171334 25996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.171352 25995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.171352 25998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:56.171732 25985 server_base.cc:1034] running on GCE node
I20260807 18:45:56.172055 25985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:56.172580 25985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:56.173741 25985 hybrid_clock.cc:648] HybridClock initialized: now 1786128356173728 us; error 33 us; skew 500 ppm
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:56.176254 25985 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:45:56.176973 25985 webserver.cc:460] Webserver started at http://127.10.174.194:42735/ using document root <none> and password file <none>
I20260807 18:45:56.177428 25985 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:56.177492 25985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:56.181084 25985 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.002s
I20260807 18:45:56.182951 26006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.184084 25985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:56.184171 25985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "db429d9d495b4d36910e1bfcb138b8da"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "680441cf579fc9e03e7c718876e1d53e"
server_key_iv: "2c3493be39b4b013ddcfb1974839d8ed"
server_key_version: "encryptionkey@0"
I20260807 18:45:56.184664 25985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:56.209411 25985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:56.211951 25985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:56.212137 25985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:56.212677 25985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:56.213455 25985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:56.213500 25985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.213565 25985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:56.213605 25985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.222232 25985 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44937
I20260807 18:45:56.222324 26122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44937 every 8 connection(s)
I20260807 18:45:56.223152 25985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:56.232383 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 25985
I20260807 18:45:56.232828 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:35531
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:38161
--webserver_port=39587
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:56.236413 25984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.224878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:48365 (local address 127.10.174.254:38161)
0807 18:45:56.225019 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.225022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.225814 (+ 792us) server_negotiation.cc:407] Connection header received
0807 18:45:56.227153 (+ 1339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.227156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.227214 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.227305 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:56.228441 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.228981 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.230116 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.230366 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.230479 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.232990 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:56.232994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:56.232997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:56.233023 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:56.234404 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.234897 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.234901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.234903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.234987 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.235327 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.235330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.235332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.235513 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:56.235622 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.236085 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.236239 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:45:56.237098 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.225201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:48365)
0807 18:45:56.225659 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.225699 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.226934 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.227500 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.227506 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.227847 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:56.228289 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.228301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.229119 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.229122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.229983 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.229992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.230515 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.230519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.230702 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.231336 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:56.231367 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:56.232826 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:56.234521 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:56.234527 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:56.234539 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:56.234793 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:56.235080 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:56.235084 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:56.235087 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:56.235215 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:56.235629 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:56.235637 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:56.235862 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.236040 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.236348 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":108,"threads_started":1}
I20260807 18:45:56.238366 26123 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38161
I20260807 18:45:56.238584 26123 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:56.239024 26123 heartbeater.cc:511] Master 127.10.174.254:38161 requested a full tablet report, sending...
I20260807 18:45:56.240101 25788 ts_manager.cc:194] Registered new tserver with Master: db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
I20260807 18:45:56.240640 25788 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:48365
W20260807 18:45:56.341063 26126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:56.341321 26126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:56.341413 26126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:56.345382 26126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:56.345469 26126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:56.345563 26126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:45:56.350811 26126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:35531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=39587
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:56.351886 26126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:56.352888 26126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:56.362355 26132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.362316 26131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:56.362383 26126 server_base.cc:1034] running on GCE node
W20260807 18:45:56.362339 26134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:56.362862 26126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:56.363566 26126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:56.364727 26126 hybrid_clock.cc:648] HybridClock initialized: now 1786128356364712 us; error 27 us; skew 500 ppm
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:56.367574 26126 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:45:56.368451 26126 webserver.cc:460] Webserver started at http://127.10.174.195:39587/ using document root <none> and password file <none>
I20260807 18:45:56.369002 26126 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:56.369073 26126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:56.372776 26126 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:45:56.374722 26141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.375924 26126 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:56.376055 26126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "f46869b37cdf4c8c91a47dbda2ef2b96"
format_stamp: "Formatted at 2026-08-07 18:45:55 on dist-test-slave-07c2"
server_key: "342e850ac1719dad315702221412840e"
server_key_iv: "1ca82361b92ef31e2924a7bcb87629e2"
server_key_version: "encryptionkey@0"
I20260807 18:45:56.376586 26126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:56.390317 26126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:56.393006 26126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:56.393153 26126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:56.393649 26126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:56.394372 26126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:56.394423 26126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.394461 26126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:56.394482 26126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.403450 26126 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:35531
I20260807 18:45:56.403503 26258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:35531 every 8 connection(s)
I20260807 18:45:56.404428 26126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:45:56.410398 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26126
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:45:56.420766 25984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.406160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:52675 (local address 127.10.174.254:38161)
0807 18:45:56.406299 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.406303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.407080 (+ 777us) server_negotiation.cc:407] Connection header received
0807 18:45:56.408500 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.408504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.408577 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.408689 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:56.409822 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.410524 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.412304 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.412729 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.412820 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.416268 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:56.416272 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:56.416275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:56.416307 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:56.418113 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.418762 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.418768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.418773 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.418868 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.419356 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.419359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.419361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.419609 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:56.419707 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.420433 (+ 726us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.420565 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:45:56.421759 26261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.406517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:52675)
0807 18:45:56.406934 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.406975 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.408289 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.408868 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.408874 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.409220 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:56.409674 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.409687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.410679 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.410686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.412140 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.412153 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.413044 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.413048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.413306 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.414027 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:56.414068 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:56.416094 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:56.418252 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:56.418260 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:56.418278 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:56.418619 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:56.418985 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:56.418991 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:56.418996 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:56.419182 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:56.419783 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:56.419791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:56.420125 (+ 334us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.420351 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.420709 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":98,"threads_started":1}
I20260807 18:45:56.422013 26262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.411171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39844 (local address 127.10.174.254:38161)
0807 18:45:56.411564 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.411568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.411883 (+ 315us) server_negotiation.cc:407] Connection header received
0807 18:45:56.412106 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.412110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.412208 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.412355 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:56.413506 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.414740 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.416058 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.416380 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.416435 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.418034 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:56.418038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:56.418040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:56.418072 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:56.419955 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.420475 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.420479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.420480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.420582 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:56.420926 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:56.420929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:56.420930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:56.421167 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:56.421337 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.421705 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.421806 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":107,"threads_started":1}
I20260807 18:45:56.423126 26259 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38161
I20260807 18:45:56.423373 26259 heartbeater.cc:464] Registering TS with master...
I20260807 18:45:56.423928 26259 heartbeater.cc:511] Master 127.10.174.254:38161 requested a full tablet report, sending...
I20260807 18:45:56.424958 25787 ts_manager.cc:194] Registered new tserver with Master: f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531)
I20260807 18:45:56.425541 25787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:52675
I20260807 18:45:56.435838 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:45:56.439815 26262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.436427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.10.174.254:38161)
0807 18:45:56.436581 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.436587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.436840 (+ 253us) server_negotiation.cc:407] Connection header received
0807 18:45:56.436944 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.436946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.437030 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.437112 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:45:56.437307 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.437787 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.438556 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.438775 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.438846 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.439088 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:45:56.439473 (+ 385us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:45:56.439570 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.439621 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.439667 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 18:45:56.440392 25787 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:39850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:45:56.443552 25787 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:45:56.450995 25914 tablet_service.cc:1467] Processing CreateTablet for tablet 1f545d9df1a141d4b8936fe24692d3bf (DEFAULT_TABLE table=test-table [id=c718096046db48719adc2f0d59d2b020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:56.451717 25914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f545d9df1a141d4b8936fe24692d3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:56.454445 25871 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap starting.
I20260807 18:45:56.455240 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.450173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44937 (local address 127.0.0.1:50820)
0807 18:45:56.450680 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.450693 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.450770 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.451375 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.451378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.451397 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:56.451481 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.451486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.452836 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.452840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.453646 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.453655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.454825 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.454829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.454946 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.454970 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.455034 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.455098 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":41,"thread_start_us":105,"threads_started":1}
I20260807 18:45:56.455343 25871 tablet_bootstrap.cc:654] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:56.455601 25987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.449881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:35531 (local address 127.0.0.1:57152)
0807 18:45:56.450008 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.450025 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.450109 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.451041 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.451044 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.451060 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:56.451150 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.451156 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.452725 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.452728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.453933 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.453944 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.454969 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.454972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.455071 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.455090 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.455132 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.455190 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":55}
I20260807 18:45:56.455747 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.450081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57152 (local address 127.10.174.195:35531)
0807 18:45:56.450577 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.450591 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.450615 (+ 24us) server_negotiation.cc:407] Connection header received
0807 18:45:56.450693 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.450700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.450915 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.451078 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:56.451242 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.452583 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.454066 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.454846 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.455354 (+ 508us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.455489 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.455532 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.455603 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":190,"threads_started":1}
I20260807 18:45:56.455744 26270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.450411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50820 (local address 127.10.174.194:44937)
0807 18:45:56.450832 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.450844 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.450867 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:45:56.450938 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.450943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.451109 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.451323 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:56.451635 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.452706 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.453765 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.454499 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.454630 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.454756 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.455494 (+ 738us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.455602 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":131,"threads_started":1}
I20260807 18:45:56.456879 25871 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: No bootstrap required, opened a new log
I20260807 18:45:56.456982 25871 ts_tablet_manager.cc:1397] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 18:45:56.457348 25871 raft_consensus.cc:348] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.457466 25871 raft_consensus.cc:374] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:56.457517 25871 raft_consensus.cc:729] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68408cea23b34cf7a8856d263b1e6a86, State: Initialized, Role: FOLLOWER
I20260807 18:45:56.457667 25871 consensus_queue.cc:260] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.457976 25871 ts_tablet_manager.cc:1428] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:45:56.458745 26192 tablet_service.cc:1467] Processing CreateTablet for tablet 1f545d9df1a141d4b8936fe24692d3bf (DEFAULT_TABLE table=test-table [id=c718096046db48719adc2f0d59d2b020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:56.459772 26192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f545d9df1a141d4b8936fe24692d3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:56.461238 26055 tablet_service.cc:1467] Processing CreateTablet for tablet 1f545d9df1a141d4b8936fe24692d3bf (DEFAULT_TABLE table=test-table [id=c718096046db48719adc2f0d59d2b020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:45:56.462177 26055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f545d9df1a141d4b8936fe24692d3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:45:56.467726 26274 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Bootstrap starting.
I20260807 18:45:56.469266 26275 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Bootstrap starting.
I20260807 18:45:56.470031 26274 tablet_bootstrap.cc:654] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:56.470708 26274 log.cc:824] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:56.471490 26275 tablet_bootstrap.cc:654] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Neither blocks nor log segments found. Creating new log.
I20260807 18:45:56.472239 26275 log.cc:824] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:56.472738 26274 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: No bootstrap required, opened a new log
I20260807 18:45:56.472888 26274 ts_tablet_manager.cc:1397] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:45:56.475558 26274 raft_consensus.cc:348] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.475827 26274 raft_consensus.cc:374] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:56.475884 26274 raft_consensus.cc:729] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f46869b37cdf4c8c91a47dbda2ef2b96, State: Initialized, Role: FOLLOWER
I20260807 18:45:56.476008 26275 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: No bootstrap required, opened a new log
I20260807 18:45:56.476202 26275 ts_tablet_manager.cc:1397] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 18:45:56.476369 26274 consensus_queue.cc:260] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.477008 26259 heartbeater.cc:503] Master 127.10.174.254:38161 was elected leader, sending a full tablet report...
I20260807 18:45:56.477347 26274 ts_tablet_manager.cc:1428] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 18:45:56.479035 26275 raft_consensus.cc:348] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.479269 26275 raft_consensus.cc:374] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:45:56.479351 26275 raft_consensus.cc:729] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db429d9d495b4d36910e1bfcb138b8da, State: Initialized, Role: FOLLOWER
I20260807 18:45:56.479709 26275 consensus_queue.cc:260] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.480279 26123 heartbeater.cc:503] Master 127.10.174.254:38161 was elected leader, sending a full tablet report...
I20260807 18:45:56.480566 26275 ts_tablet_manager.cc:1428] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Time spent starting tablet: real 0.004s user 0.000s sys 0.005s
I20260807 18:45:56.487712 26278 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:45:56.487885 26278 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.488960 26278 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937), 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887)
I20260807 18:45:56.493528 26270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.489187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:58015 (local address 127.10.174.194:44937)
0807 18:45:56.489289 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.489293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.489470 (+ 177us) server_negotiation.cc:407] Connection header received
0807 18:45:56.489514 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.489516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.489553 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.489644 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:56.489899 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.490661 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.492243 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.492857 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.492981 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.493029 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.493330 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.493402 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 18:45:56.493528 25988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.489303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:55273 (local address 127.10.174.193:33887)
0807 18:45:56.489441 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.489444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.489553 (+ 109us) server_negotiation.cc:407] Connection header received
0807 18:45:56.489687 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.489690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.489737 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.489810 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:45:56.490072 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.490787 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.492243 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.492857 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.492981 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.493036 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.493330 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.493407 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 18:45:56.493549 26261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.489132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44937 (local address 127.10.174.195:58015)
0807 18:45:56.489295 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.489310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.489399 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.489633 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.489636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.489654 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:56.489768 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.489773 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.490766 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.490768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.492099 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.492110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.492978 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.492982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.493167 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.493225 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.493302 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.493389 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":100}
I20260807 18:45:56.493562 26280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.489171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33887 (local address 127.10.174.195:55273)
0807 18:45:56.489475 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.489489 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.489572 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:56.489833 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:56.489837 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:56.489857 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:45:56.489970 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.489975 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.490909 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.490912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.492099 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:56.492110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.492978 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.492982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:56.493139 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.493219 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 18:45:56.493301 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 18:45:56.493389 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":96,"thread_start_us":85,"threads_started":1}
I20260807 18:45:56.494128 26075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f545d9df1a141d4b8936fe24692d3bf" candidate_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db429d9d495b4d36910e1bfcb138b8da" is_pre_election: true
I20260807 18:45:56.494391 26075 raft_consensus.cc:2454] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f46869b37cdf4c8c91a47dbda2ef2b96 in term 0.
I20260807 18:45:56.494335 25934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f545d9df1a141d4b8936fe24692d3bf" candidate_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68408cea23b34cf7a8856d263b1e6a86" is_pre_election: true
I20260807 18:45:56.494629 25934 raft_consensus.cc:2454] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f46869b37cdf4c8c91a47dbda2ef2b96 in term 0.
I20260807 18:45:56.494823 26145 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96; no voters:
I20260807 18:45:56.495088 26278 raft_consensus.cc:2781] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:45:56.495158 26278 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:45:56.495187 26278 raft_consensus.cc:3037] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:56.496162 26278 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.496490 26278 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [CANDIDATE]: Term 1 election: Requested vote from peers db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937), 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887)
I20260807 18:45:56.496847 26075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f545d9df1a141d4b8936fe24692d3bf" candidate_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db429d9d495b4d36910e1bfcb138b8da"
I20260807 18:45:56.496858 25934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f545d9df1a141d4b8936fe24692d3bf" candidate_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68408cea23b34cf7a8856d263b1e6a86"
I20260807 18:45:56.496970 26075 raft_consensus.cc:3037] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:56.496969 25934 raft_consensus.cc:3037] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:45:56.498188 26075 raft_consensus.cc:2454] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f46869b37cdf4c8c91a47dbda2ef2b96 in term 1.
I20260807 18:45:56.498188 25934 raft_consensus.cc:2454] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f46869b37cdf4c8c91a47dbda2ef2b96 in term 1.
I20260807 18:45:56.498445 26145 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96; no voters:
I20260807 18:45:56.498643 26278 raft_consensus.cc:2781] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:45:56.498867 26278 raft_consensus.cc:686] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 LEADER]: Becoming Leader. State: Replica: f46869b37cdf4c8c91a47dbda2ef2b96, State: Running, Role: LEADER
I20260807 18:45:56.499151 26278 consensus_queue.cc:237] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.501780 25787 catalog_manager.cc:5495] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20260807 18:45:56.517336 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.514303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57154 (local address 127.10.174.195:35531)
0807 18:45:56.514410 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:56.514415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:56.514435 (+ 20us) server_negotiation.cc:407] Connection header received
0807 18:45:56.514541 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:56.514543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:56.514588 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:56.514670 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:45:56.514886 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.515368 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.516147 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:56.516350 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:56.516435 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:56.516697 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:45:56.517053 (+ 356us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:45:56.517137 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:56.517194 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 18:45:56.517236 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 18:45:56.522588 26075 raft_consensus.cc:1261] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Refusing update from remote peer f46869b37cdf4c8c91a47dbda2ef2b96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:56.522590 25934 raft_consensus.cc:1261] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Refusing update from remote peer f46869b37cdf4c8c91a47dbda2ef2b96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:45:56.523221 26278 consensus_queue.cc:1035] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:56.523412 26281 consensus_queue.cc:1035] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:45:56.538964 25787 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:39850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:45:56.539127 25787 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:39850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:45:56.541299 25787 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Sending DeleteTablet for 3 replicas of tablet 1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:45:56.541975 26192 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f545d9df1a141d4b8936fe24692d3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:56 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:57152
I20260807 18:45:56.542004 26055 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f545d9df1a141d4b8936fe24692d3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:56 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:50820
I20260807 18:45:56.542126 25914 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f545d9df1a141d4b8936fe24692d3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:45:56 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:44584
I20260807 18:45:56.542302 25990 tablet_replica.cc:330] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: stopping tablet replica
I20260807 18:45:56.542407 25990 raft_consensus.cc:2229] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:56.542495 26295 tablet_replica.cc:330] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: stopping tablet replica
I20260807 18:45:56.542574 25990 raft_consensus.cc:2258] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:56.542929 26295 raft_consensus.cc:2229] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:45:56.543061 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25826
I20260807 18:45:56.543246 26295 raft_consensus.cc:2258] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:56.544066 26294 tablet_replica.cc:330] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: stopping tablet replica
I20260807 18:45:56.544878 26294 raft_consensus.cc:2229] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:45:56.545261 26294 raft_consensus.cc:2258] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:45:56.545688 26295 ts_tablet_manager.cc:1905] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:56.546618 26294 ts_tablet_manager.cc:1905] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:45:56.548492 26295 ts_tablet_manager.cc:1918] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:45:56.548609 26295 log.cc:1196] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:45:56.548959 26295 ts_tablet_manager.cc:1939] T 1f545d9df1a141d4b8936fe24692d3bf P db429d9d495b4d36910e1bfcb138b8da: Deleting consensus metadata
I20260807 18:45:56.549997 26294 ts_tablet_manager.cc:1918] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:45:56.550092 26294 log.cc:1196] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:45:56.550154 25775 catalog_manager.cc:4841] TS db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): tablet 1f545d9df1a141d4b8936fe24692d3bf (table test-table [id=c718096046db48719adc2f0d59d2b020]) successfully deleted
I20260807 18:45:56.550438 26294 ts_tablet_manager.cc:1939] T 1f545d9df1a141d4b8936fe24692d3bf P f46869b37cdf4c8c91a47dbda2ef2b96: Deleting consensus metadata
I20260807 18:45:56.551481 25773 catalog_manager.cc:4841] TS f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): tablet 1f545d9df1a141d4b8936fe24692d3bf (table test-table [id=c718096046db48719adc2f0d59d2b020]) successfully deleted
W20260807 18:45:56.553265 25774 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:33887 (error 108)
I20260807 18:45:56.553895 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25985
I20260807 18:45:56.554878 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:56.554021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:33887 (local address 127.0.0.1:44590)
0807 18:45:56.554693 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.554777 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:33887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563}
W20260807 18:45:56.555120 25774 catalog_manager.cc:4584] TS 68408cea23b34cf7a8856d263b1e6a86 (127.10.174.193:33887): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1f545d9df1a141d4b8936fe24692d3bf: Network error: Client connection negotiation failed: client connection to 127.10.174.193:33887: connect: Connection refused (error 111)
I20260807 18:45:56.565671 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 26126
I20260807 18:45:56.572646 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 25754
I20260807 18:45:56.579710 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38161
--webserver_interface=127.10.174.254
--webserver_port=44673
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38161
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:56.689116 26297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:56.689378 26297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:56.689419 26297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:56.693460 26297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:45:56.693513 26297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:56.693532 26297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:56.693549 26297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:45:56.693564 26297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:45:56.698693 26297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=44673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:56.699752 26297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:56.700733 26297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:56.708987 26306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.708988 26303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.709040 26304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:56.709090 26297 server_base.cc:1034] running on GCE node
I20260807 18:45:56.709743 26297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:56.710713 26297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:56.711871 26297 hybrid_clock.cc:648] HybridClock initialized: now 1786128356711854 us; error 29 us; skew 500 ppm
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:56.714429 26297 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:45:56.715232 26297 webserver.cc:460] Webserver started at http://127.10.174.254:44673/ using document root <none> and password file <none>
I20260807 18:45:56.715785 26297 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:56.715878 26297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:56.719498 26297 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 18:45:56.721618 26314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.722781 26297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:56.722913 26297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "09b5e9519cb94982bb65dbc6584d18ae"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "6f6f78ef9ee0cdce03563158155e599e"
server_key_iv: "d122bc4c04ca54b76778a13b64f4af09"
server_key_version: "encryptionkey@0"
I20260807 18:45:56.723505 26297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:56.738302 26297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:56.741159 26297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:56.741365 26297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:56.748271 26297 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38161
I20260807 18:45:56.748566 26368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38161 every 8 connection(s)
I20260807 18:45:56.749356 26297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:45:56.753432 26369 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:45:56.755033 26369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap starting.
I20260807 18:45:56.756363 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26297
I20260807 18:45:56.756866 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:33887
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:38161
--webserver_port=34855
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:56.773047 26369 log.cc:824] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:56.784091 26369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:45:56.784466 26369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae: Bootstrap complete.
I20260807 18:45:56.788468 26369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:56.788889 26369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b5e9519cb94982bb65dbc6584d18ae, State: Initialized, Role: FOLLOWER
I20260807 18:45:56.789338 26369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:56.789480 26369 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:45:56.789562 26369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:45:56.789686 26369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:45:56.791570 26369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:56.791945 26369 leader_election.cc:302] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09b5e9519cb94982bb65dbc6584d18ae; no voters:
I20260807 18:45:56.792270 26369 leader_election.cc:288] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 18:45:56.792352 26373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 3 FOLLOWER]: Leader election won for term 3
I20260807 18:45:56.792557 26373 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [term 3 LEADER]: Becoming Leader. State: Replica: 09b5e9519cb94982bb65dbc6584d18ae, State: Running, Role: LEADER
I20260807 18:45:56.792831 26373 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } }
I20260807 18:45:56.793421 26369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:45:56.793721 26376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b5e9519cb94982bb65dbc6584d18ae. Latest consensus state: current_term: 3 leader_uuid: "09b5e9519cb94982bb65dbc6584d18ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } } }
I20260807 18:45:56.793845 26376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:56.794104 26374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "09b5e9519cb94982bb65dbc6584d18ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09b5e9519cb94982bb65dbc6584d18ae" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38161 } } }
I20260807 18:45:56.794205 26374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b5e9519cb94982bb65dbc6584d18ae [sys.catalog]: This master's current role is: LEADER
I20260807 18:45:56.794214 26378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:45:56.799042 26378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:45:56.799698 26378 catalog_manager.cc:1259] Loaded cluster ID: 2b2737013c9141dbaf5b284a5fe20a6c
I20260807 18:45:56.799762 26378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 18:45:56.800859 26378 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8ed98609ad google::LogMessage::Fail() at ??:0
@ 0x7f8ed986388a google::LogMessage::SendToLog() at ??:0
@ 0x7f8ed98604de google::LogMessage::Flush() at ??:0
@ 0x7f8ed9861a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8ee419ffdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f8ee41a0d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8ee419d579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f8ee41e1640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8edbab23d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8edbab2c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f8edbab43f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f8edbaa3512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8edd0e76db start_thread at ??:0
@ 0x7f8ed835e61f clone at ??:0
W20260807 18:45:56.892381 26371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:56.892604 26371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:56.892676 26371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:56.896644 26371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:56.896694 26371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:56.896776 26371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:45:56.901844 26371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:33887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=34855
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:56.902812 26371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:56.903833 26371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:56.913058 26414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.913069 26412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:56.913044 26411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:56.913686 26371 server_base.cc:1034] running on GCE node
I20260807 18:45:56.914120 26371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:56.914754 26371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:56.915925 26371 hybrid_clock.cc:648] HybridClock initialized: now 1786128356915903 us; error 36 us; skew 500 ppm
Aug 07 18:45:56 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:56.918737 26371 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:45:56.919649 26371 webserver.cc:460] Webserver started at http://127.10.174.193:34855/ using document root <none> and password file <none>
I20260807 18:45:56.920262 26371 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:56.920356 26371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:56.924405 26371 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:45:56.926525 26421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:56.927857 26371 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:56.927985 26371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "68408cea23b34cf7a8856d263b1e6a86"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "ed75e9978e709aec0962f1aef34c3a7e"
server_key_iv: "1549c3bb3994b5f90504a402dd1c235a"
server_key_version: "encryptionkey@0"
I20260807 18:45:56.928508 26371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:56.944345 26371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:56.947448 26371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:56.947643 26371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:56.948220 26371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:56.949349 26429 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 18:45:56.954639 26371 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 18:45:56.954722 26371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 18:45:56.954809 26371 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 18:45:56.956480 26371 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 18:45:56.956550 26371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 18:45:56.956851 26429 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap starting.
I20260807 18:45:56.967231 26371 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:33887
I20260807 18:45:56.967448 26540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:33887 every 8 connection(s)
I20260807 18:45:56.968206 26371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:45:56.974339 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26371
I20260807 18:45:56.974753 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:44937
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:38161
--webserver_port=42735
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:45:56.978736 26429 log.cc:824] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Log is configured to *not* fsync() on all Append() calls
I20260807 18:45:56.987387 26429 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:45:56.987833 26429 tablet_bootstrap.cc:492] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Bootstrap complete.
I20260807 18:45:56.989292 26429 ts_tablet_manager.cc:1397] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Time spent bootstrapping tablet: real 0.033s user 0.025s sys 0.005s
I20260807 18:45:56.992405 26429 raft_consensus.cc:348] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.992920 26429 raft_consensus.cc:729] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68408cea23b34cf7a8856d263b1e6a86, State: Initialized, Role: FOLLOWER
I20260807 18:45:56.993430 26429 consensus_queue.cc:260] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:56.994477 26429 ts_tablet_manager.cc:1428] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 18:45:57.014652 26543 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:45:56.970060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:53735)
0807 18:45:56.970543 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:56.970594 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:56.971441 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:57.013767 (+ 42326us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":148,"threads_started":1}
W20260807 18:45:57.015157 26541 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:38161 (0 consecutive failures): Network error: Failed to ping master at 127.10.174.254:38161: Client connection negotiation failed: client connection to 127.10.174.254:38161: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:45:57.015956 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.015711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:58535)
0807 18:45:57.015842 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.015902 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 18:45:57.016603 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.016424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:33989)
0807 18:45:57.016519 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.016558 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 18:45:57.016865 26541 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 18:45:57.092978 26544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:57.093202 26544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:57.093274 26544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:57.097227 26544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:57.097278 26544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:57.097369 26544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:45:57.102352 26544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:44937
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=42735
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:57.103340 26544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:57.104301 26544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:57.113468 26551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:57.113435 26552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:57.113442 26554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:57.113735 26544 server_base.cc:1034] running on GCE node
I20260807 18:45:57.114147 26544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:57.114691 26544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:57.115840 26544 hybrid_clock.cc:648] HybridClock initialized: now 1786128357115813 us; error 41 us; skew 500 ppm
Aug 07 18:45:57 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:57.118384 26544 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:45:57.119230 26544 webserver.cc:460] Webserver started at http://127.10.174.194:42735/ using document root <none> and password file <none>
I20260807 18:45:57.119848 26544 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:57.119940 26544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:57.123608 26544 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 18:45:57.125499 26561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:57.126609 26544 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:57.126751 26544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "db429d9d495b4d36910e1bfcb138b8da"
format_stamp: "Formatted at 2026-08-07 18:45:54 on dist-test-slave-07c2"
server_key: "680441cf579fc9e03e7c718876e1d53e"
server_key_iv: "2c3493be39b4b013ddcfb1974839d8ed"
server_key_version: "encryptionkey@0"
I20260807 18:45:57.127264 26544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:57.149870 26544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:57.152652 26544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:57.152860 26544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:57.153436 26544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:57.154247 26544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:57.154317 26544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:57.154389 26544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:57.154433 26544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:57.163259 26544 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:44937
I20260807 18:45:57.163331 26678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:44937 every 8 connection(s)
I20260807 18:45:57.164237 26544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:45:57.167656 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.166146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:45237)
0807 18:45:57.166586 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.166993 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":110,"threads_started":1}
W20260807 18:45:57.168066 26679 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:38161 (0 consecutive failures): Network error: Failed to ping master at 127.10.174.254:38161: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
I20260807 18:45:57.168620 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.168418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:39215)
0807 18:45:57.168513 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.168567 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 18:45:57.169169 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.168998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:57061)
0807 18:45:57.169087 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.169126 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 18:45:57.169323 26679 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 18:45:57.171666 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26544
I20260807 18:45:57.172070 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:35531
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:38161
--webserver_port=39587
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:45:57.282351 26682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:45:57.282600 26682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:45:57.282642 26682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:45:57.286556 26682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:45:57.286608 26682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:45:57.286664 26682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:45:57.291817 26682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:35531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=39587
--tserver_master_addrs=127.10.174.254:38161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:45:57.292734 26682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:45:57.293658 26682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:45:57.302672 26687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:57.302672 26688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:45:57.302759 26690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:45:57.302889 26682 server_base.cc:1034] running on GCE node
I20260807 18:45:57.303390 26682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:45:57.303953 26682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:45:57.305109 26682 hybrid_clock.cc:648] HybridClock initialized: now 1786128357305097 us; error 24 us; skew 500 ppm
Aug 07 18:45:57 dist-test-slave-07c2 krb5kdc[25188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128357, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:45:57.307726 26682 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:45:57.308549 26682 webserver.cc:460] Webserver started at http://127.10.174.195:39587/ using document root <none> and password file <none>
I20260807 18:45:57.309084 26682 fs_manager.cc:359] Metadata directory not provided
I20260807 18:45:57.309176 26682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:45:57.312866 26682 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 18:45:57.314805 26697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:57.315954 26682 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:45:57.316088 26682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "f46869b37cdf4c8c91a47dbda2ef2b96"
format_stamp: "Formatted at 2026-08-07 18:45:55 on dist-test-slave-07c2"
server_key: "342e850ac1719dad315702221412840e"
server_key_iv: "1ca82361b92ef31e2924a7bcb87629e2"
server_key_version: "encryptionkey@0"
I20260807 18:45:57.316603 26682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:45:57.335942 26682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:45:57.338619 26682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:45:57.338810 26682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:45:57.339396 26682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:45:57.340159 26682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:45:57.340233 26682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:57.340294 26682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:45:57.340337 26682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:45:57.349261 26682 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:35531
I20260807 18:45:57.349341 26815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:35531 every 8 connection(s)
I20260807 18:45:57.350209 26682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:45:57.353725 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.352192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:52087)
0807 18:45:57.352645 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.353073 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":99,"threads_started":1}
W20260807 18:45:57.354133 26816 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:38161 (0 consecutive failures): Network error: Failed to ping master at 127.10.174.254:38161: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
I20260807 18:45:57.354708 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.354478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:43473)
0807 18:45:57.354592 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.354653 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 18:45:57.355322 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:57.355076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:38897)
0807 18:45:57.355177 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:57.355223 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 18:45:57.355505 26816 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 18:45:57.359258 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26682
I20260807 18:45:58.017776 26820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.017392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:53517)
0807 18:45:58.017627 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:58.017680 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":72,"threads_started":1}
I20260807 18:45:58.170203 26821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.169829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:56173)
0807 18:45:58.170050 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:58.170100 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":68,"threads_started":1}
I20260807 18:45:58.247895 26822 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:45:58.248116 26822 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:45:58.249199 26822 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
Aug 07 18:45:58 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.195@KRBTEST.COM
Aug 07 18:45:58 dist-test-slave-07c2 krb5kdc[25188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128356, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.194@KRBTEST.COM
I20260807 18:45:58.262467 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.249405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:44937 (local address 127.10.174.193:39465)
0807 18:45:58.249780 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:58.249794 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:58.249878 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:58.251863 (+ 1985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:58.251866 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:58.252081 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:58.252542 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:58.252557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.253864 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.253867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:58.254695 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:58.254704 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.255460 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.255464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:58.255626 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:58.256378 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:58.256390 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:58.258232 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:58.260384 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260387 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:58.260389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:58.260584 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:58.260936 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:58.260941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:58.261023 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:58.261739 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:58.261744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:58.261841 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 18:45:58.261964 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 18:45:58.262273 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":152,"spinlock_wait_cycles":3712,"thread_start_us":76,"threads_started":1}
I20260807 18:45:58.262495 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.249572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:39465 (local address 127.10.174.194:44937)
0807 18:45:58.249966 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:58.249986 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:58.250025 (+ 39us) server_negotiation.cc:407] Connection header received
0807 18:45:58.250795 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:58.250804 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:58.251201 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:58.251492 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:58.252723 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.253652 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.254837 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.255340 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.255511 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:58.258430 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:58.258437 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:58.258450 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:58.258482 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:58.260253 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260693 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:58.260699 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:58.260703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:58.260822 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:58.261118 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:58.261122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:58.261124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:58.261533 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:58.261647 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:58.262084 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 18:45:58.262336 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":80,"threads_started":1}
I20260807 18:45:58.262528 26826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.249572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:35657 (local address 127.10.174.195:35531)
0807 18:45:58.249996 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 18:45:58.250007 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:45:58.250040 (+ 33us) server_negotiation.cc:407] Connection header received
0807 18:45:58.250766 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:45:58.250774 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:45:58.251212 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:45:58.251532 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:45:58.252718 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.253666 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.254820 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.255280 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.255493 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:58.258095 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:45:58.258100 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:45:58.258110 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:45:58.258135 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:45:58.259942 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260439 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:58.260445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:58.260456 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:58.260562 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260907 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:45:58.260912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:45:58.260913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:45:58.261359 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:45:58.261486 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 18:45:58.262072 (+ 586us) server_negotiation.cc:299] Negotiation successful
0807 18:45:58.262352 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":92,"threads_started":1}
I20260807 18:45:58.262516 26820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.249405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:35531 (local address 127.10.174.193:35657)
0807 18:45:58.249598 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:58.249612 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:45:58.249714 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:45:58.251587 (+ 1873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:45:58.251593 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:45:58.252083 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:45:58.252542 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:58.252556 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.253844 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.253847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:58.254694 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:45:58.254704 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:45:58.255443 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:45:58.255446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:45:58.255622 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:45:58.256325 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:45:58.256340 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:45:58.257874 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:45:58.260061 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260067 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:58.260079 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:58.260323 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:58.260667 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:45:58.260670 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:45:58.260672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:45:58.260802 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:45:58.261477 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:45:58.261482 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:45:58.261761 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 18:45:58.261966 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 18:45:58.262359 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":228}
W20260807 18:45:58.265437 26425 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
W20260807 18:45:58.266057 26423 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:45:58.266139 26423 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86; no voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96
I20260807 18:45:58.266347 26822 raft_consensus.cc:2726] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:45:58.356300 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:58.355953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:54893)
0807 18:45:58.356163 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:58.356211 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":64,"threads_started":1}
I20260807 18:45:59.018893 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:59.018480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:57615)
0807 18:45:59.018742 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:59.018799 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":72,"threads_started":1}
I20260807 18:45:59.171277 26829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:59.170898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:56571)
0807 18:45:59.171141 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:59.171195 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":89,"threads_started":1}
I20260807 18:45:59.357311 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:45:59.356937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:53521)
0807 18:45:59.357158 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 18:45:59.357209 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
I20260807 18:46:00.020085 26831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:00.019680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:57073)
0807 18:46:00.019935 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:00.019989 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":83,"threads_started":1}
I20260807 18:46:00.058800 26832 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:00.058934 26832 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:46:00.059439 26832 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
W20260807 18:46:00.060225 26425 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
W20260807 18:46:00.060322 26423 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:46:00.060431 26423 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86; no voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96
I20260807 18:46:00.060590 26832 raft_consensus.cc:2726] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:46:00.172351 26833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:00.171961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:35713)
0807 18:46:00.172197 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:00.172252 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":92,"threads_started":1}
I20260807 18:46:00.358378 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:00.357991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:56089)
0807 18:46:00.358241 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:00.358295 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":93,"threads_started":1}
I20260807 18:46:01.021319 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:01.020907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:51167)
0807 18:46:01.021167 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:01.021224 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":72,"threads_started":1}
I20260807 18:46:01.173446 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:01.173038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:44821)
0807 18:46:01.173304 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:01.173359 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":92,"threads_started":1}
I20260807 18:46:01.359584 26837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:01.359073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:33673)
0807 18:46:01.359444 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:01.359497 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":82,"threads_started":1}
I20260807 18:46:02.022640 26838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:02.022181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:55981)
0807 18:46:02.022481 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:02.022538 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":76,"threads_started":1}
I20260807 18:46:02.174485 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:02.174121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:43203)
0807 18:46:02.174345 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:02.174398 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":74,"threads_started":1}
I20260807 18:46:02.360683 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:02.360305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:51571)
0807 18:46:02.360538 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:02.360594 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":72,"threads_started":1}
I20260807 18:46:02.968595 26841 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:02.968717 26841 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:46:02.969184 26841 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
W20260807 18:46:02.969970 26423 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
W20260807 18:46:02.970081 26425 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:46:02.970248 26425 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86; no voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96
I20260807 18:46:02.970394 26841 raft_consensus.cc:2726] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:46:03.023761 26843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:03.023381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:59571)
0807 18:46:03.023615 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:03.023666 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":71,"threads_started":1}
I20260807 18:46:03.175621 26844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:03.175207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:60493)
0807 18:46:03.175483 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:03.175534 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":128,"threads_started":1}
I20260807 18:46:03.361830 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:03.361458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:33793)
0807 18:46:03.361696 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:03.361747 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":69,"threads_started":1}
I20260807 18:46:04.024864 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:04.024480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:36743)
0807 18:46:04.024719 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:04.024773 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":72,"threads_started":1}
I20260807 18:46:04.176729 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:04.176298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:60617)
0807 18:46:04.176580 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:04.176634 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":73,"threads_started":1}
I20260807 18:46:04.363065 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:04.362611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:45587)
0807 18:46:04.362913 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:04.362970 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":74,"threads_started":1}
I20260807 18:46:05.026043 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:05.025631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:60863)
0807 18:46:05.025895 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:05.025949 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":99,"threads_started":1}
I20260807 18:46:05.177764 26850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:05.177368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:39761)
0807 18:46:05.177625 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:05.177675 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":106,"threads_started":1}
I20260807 18:46:05.273084 26851 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:05.273229 26851 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:46:05.273728 26851 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
W20260807 18:46:05.274650 26423 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
W20260807 18:46:05.274760 26425 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:46:05.274901 26425 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86; no voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96
I20260807 18:46:05.275059 26851 raft_consensus.cc:2726] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:46:05.364176 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:05.363805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:55663)
0807 18:46:05.364036 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:05.364086 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":75,"threads_started":1}
I20260807 18:46:06.027202 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:06.026746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:46335)
0807 18:46:06.027043 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:06.027103 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":92,"threads_started":1}
I20260807 18:46:06.179067 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:06.178476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:33791)
0807 18:46:06.178833 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:06.178947 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":91,"threads_started":1}
I20260807 18:46:06.365298 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:06.364877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:58553)
0807 18:46:06.365146 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:06.365205 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":77,"threads_started":1}
I20260807 18:46:07.028465 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:07.028078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:43217)
0807 18:46:07.028321 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:07.028371 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
I20260807 18:46:07.180233 26858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:07.179857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:60003)
0807 18:46:07.180083 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:07.180134 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":71,"threads_started":1}
I20260807 18:46:07.366511 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:07.366099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:45415)
0807 18:46:07.366357 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:07.366416 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":74,"threads_started":1}
I20260807 18:46:08.029650 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:08.029235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:57925)
0807 18:46:08.029490 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:08.029547 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":76,"threads_started":1}
I20260807 18:46:08.181427 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:08.180990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:34093)
0807 18:46:08.181274 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:08.181332 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":88,"threads_started":1}
I20260807 18:46:08.367703 26862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:08.367255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:59037)
0807 18:46:08.367560 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:08.367614 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":86,"threads_started":1}
I20260807 18:46:09.030920 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:09.030426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:45193)
0807 18:46:09.030775 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:09.030829 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":77,"threads_started":1}
I20260807 18:46:09.182578 26864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:09.182147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:34361)
0807 18:46:09.182424 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:09.182484 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":88,"threads_started":1}
I20260807 18:46:09.368790 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:09.368376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:58113)
0807 18:46:09.368628 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:09.368701 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":68,"threads_started":1}
I20260807 18:46:10.032095 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:10.031656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:44623)
0807 18:46:10.031945 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:10.032001 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":102,"threads_started":1}
I20260807 18:46:10.183739 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:10.183335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:42273)
0807 18:46:10.183587 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:10.183644 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260807 18:46:10.260681 26869 raft_consensus.cc:482] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:10.260813 26869 raft_consensus.cc:504] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f46869b37cdf4c8c91a47dbda2ef2b96" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 35531 } } peers { permanent_uuid: "db429d9d495b4d36910e1bfcb138b8da" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 44937 } } peers { permanent_uuid: "68408cea23b34cf7a8856d263b1e6a86" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 33887 } }
I20260807 18:46:10.261183 26869 leader_election.cc:288] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531), db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937)
W20260807 18:46:10.262001 26425 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db429d9d495b4d36910e1bfcb138b8da (127.10.174.194:44937): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
W20260807 18:46:10.262146 26423 leader_election.cc:341] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f46869b37cdf4c8c91a47dbda2ef2b96 (127.10.174.195:35531): Not found: Tablet not found: 1f545d9df1a141d4b8936fe24692d3bf
I20260807 18:46:10.262250 26423 leader_election.cc:302] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68408cea23b34cf7a8856d263b1e6a86; no voters: db429d9d495b4d36910e1bfcb138b8da, f46869b37cdf4c8c91a47dbda2ef2b96
I20260807 18:46:10.262419 26869 raft_consensus.cc:2726] T 1f545d9df1a141d4b8936fe24692d3bf P 68408cea23b34cf7a8856d263b1e6a86 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:46:10.369908 26870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:10.369529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:38625)
0807 18:46:10.369760 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:10.369814 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260807 18:46:11.033228 26871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:11.032805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:40259)
0807 18:46:11.033077 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:11.033132 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":89,"threads_started":1}
I20260807 18:46:11.184835 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:11.184428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:43571)
0807 18:46:11.184692 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:11.184745 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":89,"threads_started":1}
I20260807 18:46:11.371043 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:11.370634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:56803)
0807 18:46:11.370890 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:11.370945 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":96,"threads_started":1}
I20260807 18:46:12.034478 26874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:12.034075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.193:48385)
0807 18:46:12.034333 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:12.034386 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":89,"threads_started":1}
I20260807 18:46:12.186019 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:12.185622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.194:45029)
0807 18:46:12.185874 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:12.185925 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":88,"threads_started":1}
I20260807 18:46:12.360338 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 26371
I20260807 18:46:12.367654 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 26544
I20260807 18:46:12.372442 26876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:12.372021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38161 (local address 127.10.174.195:44083)
0807 18:46:12.372286 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:12.372352 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":100,"threads_started":1}
I20260807 18:46:12.374889 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 26682
2026-08-07T18:46:12Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19306 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:46:12 dist-test-slave-07c2 krb5kdc[26879](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:46:12 dist-test-slave-07c2 krb5kdc[26879](info): set up 2 sockets
Aug 07 18:46:12 dist-test-slave-07c2 krb5kdc[26879](info): commencing operation
krb5kdc: starting...
W20260807 18:46:13.426136 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:46:13 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:46:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:46:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:46:13.546581 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38413
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:13.660769 26893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:13.661038 26893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:13.661094 26893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:13.665182 26893 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 18:46:13.665238 26893 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 18:46:13.665253 26893 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 18:46:13.665267 26893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:46:13.665287 26893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:13.665305 26893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:13.665361 26893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:46:13.665383 26893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:46:13.670639 26893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:13.671733 26893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:13.672825 26893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:13.681299 26898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:13.681356 26893 server_base.cc:1034] running on GCE node
W20260807 18:46:13.681308 26901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:13.681321 26899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:13.682180 26893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:13.683172 26893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:13.684363 26893 hybrid_clock.cc:648] HybridClock initialized: now 1786128373684337 us; error 50 us; skew 500 ppm
Aug 07 18:46:13 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128373, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:13.687055 26893 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:46:13.687949 26893 webserver.cc:460] Webserver started at http://127.10.174.254:46519/ using document root <none> and password file <none>
I20260807 18:46:13.688489 26893 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:13.688585 26893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:13.688822 26893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:46:13.690783 26893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "e4ac360e8df048368de397e384ae58f5"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "94d32b180c210b854d4a27aa5f4c702d"
server_key_iv: "5ba4229e161d1fa68ef32e3b990a0843"
server_key_version: "encryptionkey@0"
I20260807 18:46:13.691416 26893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "e4ac360e8df048368de397e384ae58f5"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "94d32b180c210b854d4a27aa5f4c702d"
server_key_iv: "5ba4229e161d1fa68ef32e3b990a0843"
server_key_version: "encryptionkey@0"
I20260807 18:46:13.694855 26893 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 18:46:13.697163 26908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:13.698400 26893 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 18:46:13.698553 26893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "e4ac360e8df048368de397e384ae58f5"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "94d32b180c210b854d4a27aa5f4c702d"
server_key_iv: "5ba4229e161d1fa68ef32e3b990a0843"
server_key_version: "encryptionkey@0"
I20260807 18:46:13.698670 26893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:13.710415 26893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:13.713718 26893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:13.713927 26893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:13.720929 26893 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38413
I20260807 18:46:13.721216 26963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38413 every 8 connection(s)
I20260807 18:46:13.721882 26893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:46:13.722651 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26893
I20260807 18:46:13.722782 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:46:13.723129 10939 external_mini_cluster.cc:1428] Setting key bef90132260b21af67600d8075665a07
I20260807 18:46:13.725078 26964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:13.731956 26964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap starting.
Aug 07 18:46:13 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:46:13.734643 26964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:13.735544 26964 log.cc:824] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:13.737673 26964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: No bootstrap required, opened a new log
I20260807 18:46:13.737811 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:13.724490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41528 (local address 127.10.174.254:38413)
0807 18:46:13.724891 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:13.724906 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:13.724942 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:46:13.725637 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:13.725652 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:13.725955 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:13.726225 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:13.727118 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:13.728166 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:13.729432 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:13.729897 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:13.730017 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:13.732901 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:13.732907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:13.732921 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:13.732958 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:13.734898 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:13.735347 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:13.735353 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:13.735358 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:13.735495 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:13.735811 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:13.735814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:13.735816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:13.736235 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:13.736451 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:13.736661 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 18:46:13.736930 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":136,"threads_started":1}
I20260807 18:46:13.741089 26964 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:13.741286 26964 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:13.741320 26964 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ac360e8df048368de397e384ae58f5, State: Initialized, Role: FOLLOWER
I20260807 18:46:13.741637 26964 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:13.741743 26964 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:46:13.741780 26964 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:46:13.741843 26964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:13.742609 26964 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:13.742877 26964 leader_election.cc:302] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4ac360e8df048368de397e384ae58f5; no voters:
I20260807 18:46:13.743157 26964 leader_election.cc:288] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:46:13.743249 26969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:46:13.743518 26969 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 LEADER]: Becoming Leader. State: Replica: e4ac360e8df048368de397e384ae58f5, State: Running, Role: LEADER
I20260807 18:46:13.743863 26969 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:13.744383 26964 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:46:13.745440 26970 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4ac360e8df048368de397e384ae58f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } } }
I20260807 18:46:13.745592 26970 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:46:13.745971 26971 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4ac360e8df048368de397e384ae58f5. Latest consensus state: current_term: 1 leader_uuid: "e4ac360e8df048368de397e384ae58f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } } }
I20260807 18:46:13.746058 26978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:46:13.746099 26971 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:46:13.749087 26978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:46:13.754598 26978 catalog_manager.cc:1347] Generated new cluster ID: e5f8a8c2f1aa47fd8caadcbf020e127b
I20260807 18:46:13.754659 26978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:46:13.781775 26978 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:46:13.782663 26978 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:46:13.798254 26978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Generated new TSK 0
I20260807 18:46:13.799029 26978 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:46:13.837656 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38413
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:13.947135 26991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:13.947436 26991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:13.947512 26991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:13.951474 26991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:13.951520 26991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:13.951612 26991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:46:13.956851 26991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:13.957772 26991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:13.958702 26991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:13.967631 26997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:13.967599 26999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:13.967675 26991 server_base.cc:1034] running on GCE node
W20260807 18:46:13.967638 26996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:13.968189 26991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:13.968778 26991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:13.969959 26991 hybrid_clock.cc:648] HybridClock initialized: now 1786128373969946 us; error 32 us; skew 500 ppm
Aug 07 18:46:13 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128373, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:13.972586 26991 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:46:13.973454 26991 webserver.cc:460] Webserver started at http://127.10.174.193:39137/ using document root <none> and password file <none>
I20260807 18:46:13.973973 26991 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:13.974063 26991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:13.974282 26991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:46:13.976203 26991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "5c96194164394d87836a66264ef81f00"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "5f0920c265ceb603659ed5002b1eb78d"
server_key_iv: "15bcdc97182b437a1b0bf344e819fe4e"
server_key_version: "encryptionkey@0"
I20260807 18:46:13.976734 26991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "5c96194164394d87836a66264ef81f00"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "5f0920c265ceb603659ed5002b1eb78d"
server_key_iv: "15bcdc97182b437a1b0bf344e819fe4e"
server_key_version: "encryptionkey@0"
I20260807 18:46:13.980151 26991 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:46:13.982322 27007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:13.983470 26991 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:46:13.983594 26991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "5c96194164394d87836a66264ef81f00"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "5f0920c265ceb603659ed5002b1eb78d"
server_key_iv: "15bcdc97182b437a1b0bf344e819fe4e"
server_key_version: "encryptionkey@0"
I20260807 18:46:13.983701 26991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:13.999529 26991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:14.002425 26991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:14.002683 26991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:14.003367 26991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:14.004226 26991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:14.004297 26991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.004367 26991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:14.004397 26991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.013289 26991 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:45421
I20260807 18:46:14.013330 27124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:45421 every 8 connection(s)
I20260807 18:46:14.014185 26991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
Aug 07 18:46:14 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128373, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:46:14.024073 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 26991
I20260807 18:46:14.024205 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:46:14.024533 10939 external_mini_cluster.cc:1428] Setting key 75230ae84fe49c294fb4ff2a01349da7
I20260807 18:46:14.027472 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.015892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:34491 (local address 127.10.174.254:38413)
0807 18:46:14.016045 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.016050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.016863 (+ 813us) server_negotiation.cc:407] Connection header received
0807 18:46:14.018039 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.018042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.018087 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.018159 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:14.019194 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.019786 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.020845 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.021059 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.021132 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.023446 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:14.023449 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:14.023451 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:14.023473 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:14.025235 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.025918 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.025921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.025922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.025996 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.026341 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.026360 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.026361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.026534 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:14.026639 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.027124 (+ 485us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.027254 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:46:14.028443 27127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.016280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:34491)
0807 18:46:14.016708 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.016749 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.017851 (+ 1102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.018294 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.018300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.018626 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:14.019063 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.019076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.019894 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.019896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.020744 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.020753 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.021190 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.021193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.021322 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.021828 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:14.021843 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:14.023251 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:14.025350 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:14.025355 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:14.025368 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:14.025618 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:14.026096 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:14.026100 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:14.026102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:14.026243 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:14.026638 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:14.026645 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:14.026888 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.027082 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.027411 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":114,"threads_started":1}
I20260807 18:46:14.029636 27125 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38413
I20260807 18:46:14.029906 27125 heartbeater.cc:464] Registering TS with master...
I20260807 18:46:14.030428 27125 heartbeater.cc:511] Master 127.10.174.254:38413 requested a full tablet report, sending...
I20260807 18:46:14.031987 26926 ts_manager.cc:194] Registered new tserver with Master: 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421)
I20260807 18:46:14.033041 26926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:34491
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:46:14.053894 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38413
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:14.163208 27130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:14.163437 27130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:14.163477 27130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:14.167567 27130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:14.167622 27130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:14.167677 27130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:46:14.172523 27130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:14.173455 27130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:14.174396 27130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:14.183168 27135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:14.183342 27130 server_base.cc:1034] running on GCE node
W20260807 18:46:14.183190 27139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:14.183534 27137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:14.183890 27130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:14.184509 27130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:14.185686 27130 hybrid_clock.cc:648] HybridClock initialized: now 1786128374185670 us; error 29 us; skew 500 ppm
Aug 07 18:46:14 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128374, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:14.188382 27130 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:46:14.189117 27130 webserver.cc:460] Webserver started at http://127.10.174.194:36769/ using document root <none> and password file <none>
I20260807 18:46:14.189590 27130 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:14.189646 27130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:14.189795 27130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:46:14.191672 27130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "14544263d3cd4afbb3d511078ce1058d"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "fa6582cb6b26f217fdee828a0a34adee"
server_key_iv: "a32f80da276b732d278115cc853b338b"
server_key_version: "encryptionkey@0"
I20260807 18:46:14.192152 27130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "14544263d3cd4afbb3d511078ce1058d"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "fa6582cb6b26f217fdee828a0a34adee"
server_key_iv: "a32f80da276b732d278115cc853b338b"
server_key_version: "encryptionkey@0"
I20260807 18:46:14.195484 27130 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:46:14.197672 27146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.198818 27130 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:14.198932 27130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "14544263d3cd4afbb3d511078ce1058d"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "fa6582cb6b26f217fdee828a0a34adee"
server_key_iv: "a32f80da276b732d278115cc853b338b"
server_key_version: "encryptionkey@0"
I20260807 18:46:14.199033 27130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:14.224041 27130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:14.226647 27130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:14.226845 27130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:14.227419 27130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:14.228173 27130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:14.228224 27130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.228289 27130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:14.228327 27130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.236816 27130 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:42313
I20260807 18:46:14.236842 27263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:42313 every 8 connection(s)
I20260807 18:46:14.237727 27130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:46:14.240322 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 27130
I20260807 18:46:14.240446 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:46:14.240739 10939 external_mini_cluster.cc:1428] Setting key d04fa8e1410cd83dd7c4a8a0201e87c4
Aug 07 18:46:14 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128374, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:46:14.250679 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.239339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:48499 (local address 127.10.174.254:38413)
0807 18:46:14.239467 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.239470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.240170 (+ 700us) server_negotiation.cc:407] Connection header received
0807 18:46:14.241591 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.241594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.241651 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.241757 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:14.242909 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.243480 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.244616 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.244841 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.244949 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.247336 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:14.247341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:14.247348 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:14.247369 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:14.248769 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.249254 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.249259 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.249261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.249338 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.249684 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.249689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.249690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.249856 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:14.249962 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.250394 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.250511 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:46:14.251462 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.239630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:48499)
0807 18:46:14.240034 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.240071 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.241398 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.241944 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.241952 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.242334 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:14.242769 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.242782 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.243600 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.243608 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.244499 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.244508 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.244982 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.244986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.245148 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.245746 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:14.245761 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:14.247160 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:14.248887 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:14.248892 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:14.248905 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:14.249151 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:14.249446 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:14.249449 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:14.249451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:14.249580 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:14.249961 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:14.249967 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:14.250180 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.250352 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.250641 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260807 18:46:14.252439 27264 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38413
I20260807 18:46:14.252635 27264 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
I20260807 18:46:14.253095 27264 heartbeater.cc:511] Master 127.10.174.254:38413 requested a full tablet report, sending...
I20260807 18:46:14.254204 26926 ts_manager.cc:194] Registered new tserver with Master: 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313)
I20260807 18:46:14.254822 26926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:48499
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:46:14.266376 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38413
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:14.374850 27269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:14.375083 27269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:14.375123 27269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:14.378961 27269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:14.379009 27269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:14.379065 27269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:46:14.384136 27269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:14.385030 27269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:14.385953 27269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:14.395145 27275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:14.395169 27278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:14.395170 27276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:14.395484 27269 server_base.cc:1034] running on GCE node
I20260807 18:46:14.395880 27269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:14.396435 27269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:14.397614 27269 hybrid_clock.cc:648] HybridClock initialized: now 1786128374397601 us; error 32 us; skew 500 ppm
Aug 07 18:46:14 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128374, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:14.400179 27269 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:46:14.401002 27269 webserver.cc:460] Webserver started at http://127.10.174.195:43801/ using document root <none> and password file <none>
I20260807 18:46:14.401649 27269 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:14.401741 27269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:14.401945 27269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:46:14.403991 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "f7cc64d70f7347bda528232fe00b1452"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "e97246698831a692fe88b8cacc0b2643"
server_key_iv: "3a5fd4b3dd15536def51d5dc22657841"
server_key_version: "encryptionkey@0"
I20260807 18:46:14.404525 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "f7cc64d70f7347bda528232fe00b1452"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "e97246698831a692fe88b8cacc0b2643"
server_key_iv: "3a5fd4b3dd15536def51d5dc22657841"
server_key_version: "encryptionkey@0"
I20260807 18:46:14.407891 27269 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:46:14.410043 27285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.411129 27269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:14.411270 27269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "f7cc64d70f7347bda528232fe00b1452"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "e97246698831a692fe88b8cacc0b2643"
server_key_iv: "3a5fd4b3dd15536def51d5dc22657841"
server_key_version: "encryptionkey@0"
I20260807 18:46:14.411430 27269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:14.429229 27269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:14.431708 27269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:14.431910 27269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:14.432452 27269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:14.433180 27269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:14.433259 27269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.433328 27269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:14.433363 27269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:14.442198 27269 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39533
I20260807 18:46:14.442258 27402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39533 every 8 connection(s)
I20260807 18:46:14.443046 27269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
Aug 07 18:46:14 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128374, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:46:14.452322 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 27269
I20260807 18:46:14.452461 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:46:14.452822 10939 external_mini_cluster.cc:1428] Setting key c3586c43a21b8cb8d4a292e0e6210c69
I20260807 18:46:14.455940 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.444885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:46099 (local address 127.10.174.254:38413)
0807 18:46:14.445035 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.445039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.445790 (+ 751us) server_negotiation.cc:407] Connection header received
0807 18:46:14.447020 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.447022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.447069 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.447140 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:14.448268 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.448795 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.449833 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.450034 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.450106 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.452410 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:14.452416 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:14.452420 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:14.452446 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:14.454002 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.454588 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.454591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.454592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.454662 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.455038 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.455041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.455043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.455212 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:14.455356 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.455740 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.455831 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:46:14.456668 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.445209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:46099)
0807 18:46:14.445636 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.445683 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.446836 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.447364 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.447370 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.447718 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:14.448141 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.448154 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.448897 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.448900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.449733 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.449741 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.450153 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.450156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.450286 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.450858 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:14.450873 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:14.452246 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:14.454109 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:14.454115 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:14.454126 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:14.454483 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:14.454754 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:14.454757 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:14.454759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:14.454934 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:14.455350 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:14.455355 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:14.455553 (+ 198us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.455696 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.455902 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":109,"threads_started":1}
I20260807 18:46:14.457587 27403 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38413
I20260807 18:46:14.457824 27403 heartbeater.cc:464] Registering TS with master...
I20260807 18:46:14.458267 27403 heartbeater.cc:511] Master 127.10.174.254:38413 requested a full tablet report, sending...
I20260807 18:46:14.459178 26926 ts_manager.cc:194] Registered new tserver with Master: f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
I20260807 18:46:14.459736 26926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:46099
I20260807 18:46:14.466750 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:46:14.476060 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.468687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41536 (local address 127.10.174.254:38413)
0807 18:46:14.468807 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.468810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.469053 (+ 243us) server_negotiation.cc:407] Connection header received
0807 18:46:14.469171 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.469173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.469207 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.469272 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:14.469982 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.470456 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.471434 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.471628 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.471701 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.473113 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:14.473116 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:14.473118 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:14.473134 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:14.474513 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.474932 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.474934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.474935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.475002 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:14.475274 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:14.475276 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:14.475277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:14.475543 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:14.475645 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.475857 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.475951 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 18:46:14.478780 26926 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:46:14.481724 26926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:46:14.495499 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.490180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.10.174.193:45421)
0807 18:46:14.490515 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.490532 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.490557 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:46:14.490907 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.490914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.491120 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.491305 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.491617 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.492420 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.494058 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.494803 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.494943 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.495075 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.495226 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.495344 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":59,"threads_started":1}
I20260807 18:46:14.495488 27414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.490010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:45421 (local address 127.0.0.1:32790)
0807 18:46:14.490388 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.490441 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.490563 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.491316 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.491322 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.491344 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.491472 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.491479 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.492546 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.492552 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.493918 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.493929 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.494929 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.494933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.495039 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.495073 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.495195 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.495340 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":96,"threads_started":1}
I20260807 18:46:14.496363 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.490777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42313 (local address 127.0.0.1:55252)
0807 18:46:14.491594 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.491608 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.491711 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.492144 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.492147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.492165 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.492268 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.492275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.493657 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.493661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.494821 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.494831 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.495939 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.495944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.496049 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.496074 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.496167 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.496243 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":3,"thread_start_us":114,"threads_started":1}
I20260807 18:46:14.496438 27419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.490924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55252 (local address 127.10.174.194:42313)
0807 18:46:14.491416 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.491427 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.491681 (+ 254us) server_negotiation.cc:407] Connection header received
0807 18:46:14.491819 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.491824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.492005 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.492171 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.492364 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.493516 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.494955 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.495821 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.495935 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.496041 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.496195 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.496295 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":120,"threads_started":1}
I20260807 18:46:14.497219 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.490383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39533 (local address 127.0.0.1:57620)
0807 18:46:14.492550 (+ 2167us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.492561 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.492674 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.493048 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.493051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.493069 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.493175 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.493184 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.494445 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.494448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.495590 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.495601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.496844 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.496847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.496942 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.496963 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.497033 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.497106 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":778,"thread_start_us":93,"threads_started":1}
I20260807 18:46:14.497651 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.490809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57620 (local address 127.10.174.195:39533)
0807 18:46:14.491959 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.491970 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.492660 (+ 690us) server_negotiation.cc:407] Connection header received
0807 18:46:14.492794 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.492798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.492923 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.493068 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.493282 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.494299 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.495731 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.496547 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.496663 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.496781 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.497436 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.497523 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1051,"thread_start_us":155,"threads_started":1}
I20260807 18:46:14.498720 27197 tablet_service.cc:1467] Processing CreateTablet for tablet 2719cf1be4fc48bda0d67ec0bde0aecf (DEFAULT_TABLE table=test-table [id=d1d19ab7bcf54d67a599ac662cede251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:46:14.498724 27056 tablet_service.cc:1467] Processing CreateTablet for tablet 2719cf1be4fc48bda0d67ec0bde0aecf (DEFAULT_TABLE table=test-table [id=d1d19ab7bcf54d67a599ac662cede251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:46:14.499687 27197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2719cf1be4fc48bda0d67ec0bde0aecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:14.499688 27056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2719cf1be4fc48bda0d67ec0bde0aecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:14.503679 27334 tablet_service.cc:1467] Processing CreateTablet for tablet 2719cf1be4fc48bda0d67ec0bde0aecf (DEFAULT_TABLE table=test-table [id=d1d19ab7bcf54d67a599ac662cede251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:46:14.504673 27334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2719cf1be4fc48bda0d67ec0bde0aecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:14.506989 27422 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Bootstrap starting.
I20260807 18:46:14.507601 27421 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Bootstrap starting.
I20260807 18:46:14.509238 27421 tablet_bootstrap.cc:654] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:14.509655 27422 tablet_bootstrap.cc:654] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:14.510340 27421 log.cc:824] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:14.510476 27422 log.cc:824] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:14.512192 27426 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Bootstrap starting.
I20260807 18:46:14.512521 27421 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: No bootstrap required, opened a new log
I20260807 18:46:14.512533 27422 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: No bootstrap required, opened a new log
I20260807 18:46:14.512719 27422 ts_tablet_manager.cc:1397] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:46:14.512728 27421 ts_tablet_manager.cc:1397] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:46:14.514675 27426 tablet_bootstrap.cc:654] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:14.515575 27426 log.cc:824] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:14.516178 27421 raft_consensus.cc:348] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.516482 27421 raft_consensus.cc:374] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:14.516539 27421 raft_consensus.cc:729] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c96194164394d87836a66264ef81f00, State: Initialized, Role: FOLLOWER
I20260807 18:46:14.516616 27422 raft_consensus.cc:348] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.516868 27422 raft_consensus.cc:374] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:14.516921 27422 raft_consensus.cc:729] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14544263d3cd4afbb3d511078ce1058d, State: Initialized, Role: FOLLOWER
I20260807 18:46:14.517015 27421 consensus_queue.cc:260] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.517338 27422 consensus_queue.cc:260] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.517668 27426 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: No bootstrap required, opened a new log
I20260807 18:46:14.517860 27426 ts_tablet_manager.cc:1397] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:46:14.518083 27421 ts_tablet_manager.cc:1428] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:46:14.518263 27422 ts_tablet_manager.cc:1428] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:46:14.518426 27125 heartbeater.cc:503] Master 127.10.174.254:38413 was elected leader, sending a full tablet report...
I20260807 18:46:14.519443 27264 heartbeater.cc:503] Master 127.10.174.254:38413 was elected leader, sending a full tablet report...
I20260807 18:46:14.521373 27426 raft_consensus.cc:348] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.521672 27426 raft_consensus.cc:374] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:14.521744 27426 raft_consensus.cc:729] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7cc64d70f7347bda528232fe00b1452, State: Initialized, Role: FOLLOWER
I20260807 18:46:14.522162 27426 consensus_queue.cc:260] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.522773 27403 heartbeater.cc:503] Master 127.10.174.254:38413 was elected leader, sending a full tablet report...
I20260807 18:46:14.523144 27426 ts_tablet_manager.cc:1428] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:46:14.556568 27430 raft_consensus.cc:482] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:14.556819 27430 raft_consensus.cc:504] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.558041 27430 leader_election.cc:288] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421), 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313)
I20260807 18:46:14.560254 27428 raft_consensus.cc:482] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:14.560473 27428 raft_consensus.cc:504] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.562070 27428 leader_election.cc:288] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313), f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
I20260807 18:46:14.562954 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.558263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:45421 (local address 127.10.174.195:33091)
0807 18:46:14.558391 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.558410 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.558512 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.558914 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.558921 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.558946 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.559095 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.559101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.560133 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.560138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.561476 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.561487 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.562469 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.562473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.562586 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.562623 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.562694 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.562784 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":60,"spinlock_wait_cycles":7552}
I20260807 18:46:14.563011 27419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.558712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:38887 (local address 127.10.174.194:42313)
0807 18:46:14.558835 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.558841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.558982 (+ 141us) server_negotiation.cc:407] Connection header received
0807 18:46:14.559099 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.559101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.559142 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.559243 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.559530 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.560235 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.561684 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.562265 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.562351 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.562401 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.562791 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.562867 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:46:14.563441 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.558568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42313 (local address 127.10.174.195:38887)
0807 18:46:14.558886 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.558899 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.559006 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.559261 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.559263 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.559279 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.559424 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.559428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.560354 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.560357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.561531 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.561542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.562493 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.562499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.562628 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.562658 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.563189 (+ 531us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.563262 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":21,"spinlock_wait_cycles":3200,"thread_start_us":148,"threads_started":1}
I20260807 18:46:14.563449 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.558471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:33091 (local address 127.10.174.193:45421)
0807 18:46:14.558634 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.558638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.558656 (+ 18us) server_negotiation.cc:407] Connection header received
0807 18:46:14.558717 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.558720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.558789 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.558881 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.559208 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.560014 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.561634 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.562241 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.562351 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.562401 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.563219 (+ 818us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.563331 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 18:46:14.563936 27217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2719cf1be4fc48bda0d67ec0bde0aecf" candidate_uuid: "f7cc64d70f7347bda528232fe00b1452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14544263d3cd4afbb3d511078ce1058d" is_pre_election: true
I20260807 18:46:14.563936 27078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2719cf1be4fc48bda0d67ec0bde0aecf" candidate_uuid: "f7cc64d70f7347bda528232fe00b1452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c96194164394d87836a66264ef81f00" is_pre_election: true
I20260807 18:46:14.564177 27078 raft_consensus.cc:2454] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7cc64d70f7347bda528232fe00b1452 in term 0.
I20260807 18:46:14.564213 27217 raft_consensus.cc:2454] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7cc64d70f7347bda528232fe00b1452 in term 0.
I20260807 18:46:14.564687 27287 leader_election.cc:302] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c96194164394d87836a66264ef81f00, f7cc64d70f7347bda528232fe00b1452; no voters:
I20260807 18:46:14.565027 27430 raft_consensus.cc:2781] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:46:14.565128 27430 raft_consensus.cc:482] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:46:14.565183 27430 raft_consensus.cc:3037] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:14.566578 27430 raft_consensus.cc:504] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.566709 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.561926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:52125 (local address 127.10.174.195:39533)
0807 18:46:14.562030 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.562035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.562387 (+ 352us) server_negotiation.cc:407] Connection header received
0807 18:46:14.562567 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.562570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.562610 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.562653 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.563355 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.564036 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.565502 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.566026 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.566115 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.566159 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.566536 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.566616 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 18:46:14.566706 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.561580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39533 (local address 127.10.174.193:52125)
0807 18:46:14.562302 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.562317 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.562458 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.562783 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.562786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.562804 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.562913 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.562920 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.564169 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.564172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.565363 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.565374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.566247 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.566251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.566355 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.566370 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.566497 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.566568 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":2,"thread_start_us":76,"threads_started":1}
I20260807 18:46:14.566980 27430 leader_election.cc:288] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [CANDIDATE]: Term 1 election: Requested vote from peers 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421), 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313)
I20260807 18:46:14.567401 27355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2719cf1be4fc48bda0d67ec0bde0aecf" candidate_uuid: "5c96194164394d87836a66264ef81f00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7cc64d70f7347bda528232fe00b1452" is_pre_election: true
I20260807 18:46:14.567500 27217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2719cf1be4fc48bda0d67ec0bde0aecf" candidate_uuid: "f7cc64d70f7347bda528232fe00b1452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14544263d3cd4afbb3d511078ce1058d"
I20260807 18:46:14.567500 27078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2719cf1be4fc48bda0d67ec0bde0aecf" candidate_uuid: "f7cc64d70f7347bda528232fe00b1452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c96194164394d87836a66264ef81f00"
I20260807 18:46:14.567618 27078 raft_consensus.cc:3037] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:14.567641 27355 raft_consensus.cc:2379] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c96194164394d87836a66264ef81f00 in current term 1: Already voted for candidate f7cc64d70f7347bda528232fe00b1452 in this term.
I20260807 18:46:14.567618 27217 raft_consensus.cc:3037] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:14.567802 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.561586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42313 (local address 127.10.174.193:43153)
0807 18:46:14.562576 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.562589 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:14.562706 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:14.563064 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:14.563068 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:14.563090 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:14.563214 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.563221 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.564972 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.564975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.566322 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:14.566336 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.567391 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.567396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:14.567489 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.567515 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 18:46:14.567589 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 18:46:14.567665 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":108,"thread_start_us":107,"threads_started":1}
I20260807 18:46:14.568277 27434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.561955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43153 (local address 127.10.174.194:42313)
0807 18:46:14.562372 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.562384 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.562788 (+ 404us) server_negotiation.cc:407] Connection header received
0807 18:46:14.562833 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.562835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.562876 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.562947 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:14.563358 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.564860 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.566460 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.567090 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.567257 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.567326 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.568005 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.568093 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":94,"threads_started":1}
I20260807 18:46:14.568910 27078 raft_consensus.cc:2454] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7cc64d70f7347bda528232fe00b1452 in term 1.
I20260807 18:46:14.568910 27217 raft_consensus.cc:2454] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7cc64d70f7347bda528232fe00b1452 in term 1.
I20260807 18:46:14.569231 27287 leader_election.cc:302] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c96194164394d87836a66264ef81f00, f7cc64d70f7347bda528232fe00b1452; no voters:
I20260807 18:46:14.569391 27430 raft_consensus.cc:2781] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:46:14.569515 27217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2719cf1be4fc48bda0d67ec0bde0aecf" candidate_uuid: "5c96194164394d87836a66264ef81f00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14544263d3cd4afbb3d511078ce1058d" is_pre_election: true
I20260807 18:46:14.569619 27430 raft_consensus.cc:686] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 1 LEADER]: Becoming Leader. State: Replica: f7cc64d70f7347bda528232fe00b1452, State: Running, Role: LEADER
I20260807 18:46:14.569710 27217 raft_consensus.cc:2379] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c96194164394d87836a66264ef81f00 in current term 1: Already voted for candidate f7cc64d70f7347bda528232fe00b1452 in this term.
I20260807 18:46:14.569957 27430 consensus_queue.cc:237] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:14.570113 27009 leader_election.cc:302] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c96194164394d87836a66264ef81f00; no voters: 14544263d3cd4afbb3d511078ce1058d, f7cc64d70f7347bda528232fe00b1452
I20260807 18:46:14.570384 27428 raft_consensus.cc:2726] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 18:46:14.573199 26925 catalog_manager.cc:5495] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7cc64d70f7347bda528232fe00b1452 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "f7cc64d70f7347bda528232fe00b1452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } health_report { overall_health: HEALTHY } } }
I20260807 18:46:14.593668 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.589892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57632 (local address 127.10.174.195:39533)
0807 18:46:14.590033 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:14.590038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:14.590054 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:46:14.590175 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:14.590178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:14.590229 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:14.590351 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:46:14.590614 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.591114 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.592262 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:14.592480 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:14.592584 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:14.592906 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:46:14.593283 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:46:14.593413 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:14.593476 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 18:46:14.593525 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:46:14.599428 27217 raft_consensus.cc:1261] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Refusing update from remote peer f7cc64d70f7347bda528232fe00b1452: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:46:14.599428 27078 raft_consensus.cc:1261] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Refusing update from remote peer f7cc64d70f7347bda528232fe00b1452: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:46:14.600121 27435 consensus_queue.cc:1035] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:46:14.600346 27430 consensus_queue.cc:1035] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:46:14.610196 27439 mvcc.cc:205] Tried to move back new op lower bound from 7315981822351544320 to 7315981822241546240. Current Snapshot: MvccSnapshot[applied={T|T < 7315981822351544320 or (T in {7315981822351544320})}]
I20260807 18:46:14.615337 26925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:46:14.615511 26925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:46:14.617722 26925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Sending DeleteTablet for 3 replicas of tablet 2719cf1be4fc48bda0d67ec0bde0aecf
I20260807 18:46:14.618496 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 26991
I20260807 18:46:14.618462 27334 tablet_service.cc:1514] Processing DeleteTablet for tablet 2719cf1be4fc48bda0d67ec0bde0aecf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:46:14 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:57620
I20260807 18:46:14.618487 27197 tablet_service.cc:1514] Processing DeleteTablet for tablet 2719cf1be4fc48bda0d67ec0bde0aecf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:46:14 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:55252
I20260807 18:46:14.620482 27447 tablet_replica.cc:330] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: stopping tablet replica
I20260807 18:46:14.620865 27447 raft_consensus.cc:2229] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:46:14.621373 27447 raft_consensus.cc:2258] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:46:14.623209 27447 ts_tablet_manager.cc:1905] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:46:14.627126 27447 ts_tablet_manager.cc:1918] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:46:14.627238 27447 log.cc:1196] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/2719cf1be4fc48bda0d67ec0bde0aecf
I20260807 18:46:14.627507 27448 tablet_replica.cc:330] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: stopping tablet replica
I20260807 18:46:14.627610 27447 ts_tablet_manager.cc:1939] T 2719cf1be4fc48bda0d67ec0bde0aecf P f7cc64d70f7347bda528232fe00b1452: Deleting consensus metadata
I20260807 18:46:14.627900 27448 raft_consensus.cc:2229] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:46:14.628247 27448 raft_consensus.cc:2258] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:46:14.628808 26911 catalog_manager.cc:4841] TS f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): tablet 2719cf1be4fc48bda0d67ec0bde0aecf (table test-table [id=d1d19ab7bcf54d67a599ac662cede251]) successfully deleted
I20260807 18:46:14.629659 27448 ts_tablet_manager.cc:1905] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:46:14.632179 27448 ts_tablet_manager.cc:1918] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:46:14.632282 27448 log.cc:1196] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/2719cf1be4fc48bda0d67ec0bde0aecf
I20260807 18:46:14.632939 27448 ts_tablet_manager.cc:1939] T 2719cf1be4fc48bda0d67ec0bde0aecf P 14544263d3cd4afbb3d511078ce1058d: Deleting consensus metadata
W20260807 18:46:14.633677 26910 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:45421 (error 108)
I20260807 18:46:14.633977 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 27130
I20260807 18:46:14.634151 26910 catalog_manager.cc:4841] TS 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): tablet 2719cf1be4fc48bda0d67ec0bde0aecf (table test-table [id=d1d19ab7bcf54d67a599ac662cede251]) successfully deleted
I20260807 18:46:14.635715 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:14.635211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:45421 (local address 127.0.0.1:32806)
0807 18:46:14.635545 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:14.635633 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:45421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231}
W20260807 18:46:14.636413 26910 catalog_manager.cc:4584] TS 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2719cf1be4fc48bda0d67ec0bde0aecf: Network error: Client connection negotiation failed: client connection to 127.10.174.193:45421: connect: Connection refused (error 111)
I20260807 18:46:14.642591 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 27269
I20260807 18:46:14.649644 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 26893
I20260807 18:46:34.656651 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38413
--webserver_interface=127.10.174.254
--webserver_port=46519
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:34.765552 27450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:34.765776 27450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:34.765813 27450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:34.769711 27450 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 18:46:34.769755 27450 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 18:46:34.769771 27450 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 18:46:34.769785 27450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:46:34.769802 27450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:34.769819 27450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:34.769834 27450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:46:34.769850 27450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:46:34.774714 27450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=46519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:34.775558 27450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:34.776443 27450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:34.789151 27459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:34.789125 27457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:34.789124 27456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:34.789441 27450 server_base.cc:1034] running on GCE node
I20260807 18:46:34.790022 27450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:34.791261 27450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:34.792465 27450 hybrid_clock.cc:648] HybridClock initialized: now 1786128394792451 us; error 28 us; skew 500 ppm
Aug 07 18:46:34 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128394, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:34.795425 27450 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:46:34.796271 27450 webserver.cc:460] Webserver started at http://127.10.174.254:46519/ using document root <none> and password file <none>
I20260807 18:46:34.796839 27450 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:34.796942 27450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:34.800786 27450 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 18:46:34.802870 27466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:34.804067 27450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:34.804220 27450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "e4ac360e8df048368de397e384ae58f5"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "94d32b180c210b854d4a27aa5f4c702d"
server_key_iv: "5ba4229e161d1fa68ef32e3b990a0843"
server_key_version: "encryptionkey@0"
I20260807 18:46:34.804804 27450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:34.826952 27450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:34.829701 27450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:34.829905 27450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:34.837013 27450 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38413
I20260807 18:46:34.837275 27519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38413 every 8 connection(s)
I20260807 18:46:34.838016 27450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:46:34.842176 27520 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:46:34.843811 27520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap starting.
I20260807 18:46:34.843930 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 27450
I20260807 18:46:34.844359 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:45421
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:38413
--webserver_port=39137
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:46:34.860718 27520 log.cc:824] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:34.869235 27520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:46:34.869597 27520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap complete.
I20260807 18:46:34.873514 27520 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:34.873915 27520 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ac360e8df048368de397e384ae58f5, State: Initialized, Role: FOLLOWER
I20260807 18:46:34.874389 27520 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:34.874496 27520 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:46:34.874598 27520 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:46:34.874717 27520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 18:46:34.876526 27520 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:34.876859 27520 leader_election.cc:302] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4ac360e8df048368de397e384ae58f5; no voters:
I20260807 18:46:34.877166 27520 leader_election.cc:288] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 18:46:34.877242 27524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 18:46:34.877447 27524 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 LEADER]: Becoming Leader. State: Replica: e4ac360e8df048368de397e384ae58f5, State: Running, Role: LEADER
I20260807 18:46:34.877786 27524 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:34.878329 27520 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:46:34.878670 27524 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4ac360e8df048368de397e384ae58f5. Latest consensus state: current_term: 2 leader_uuid: "e4ac360e8df048368de397e384ae58f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } } }
I20260807 18:46:34.878861 27524 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:46:34.879118 27525 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e4ac360e8df048368de397e384ae58f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } } }
I20260807 18:46:34.879323 27525 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:46:34.879329 27528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:46:34.884336 27528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:46:34.885150 27528 catalog_manager.cc:1259] Loaded cluster ID: e5f8a8c2f1aa47fd8caadcbf020e127b
I20260807 18:46:34.885222 27528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:46:34.887545 27528 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:46:34.888195 27528 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Loaded TSK: 0
I20260807 18:46:34.908780 27528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Generated new TSK 1
I20260807 18:46:34.909025 27528 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 18:46:34.962116 27522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:34.962373 27522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:34.962415 27522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:34.966451 27522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:34.966512 27522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:34.966594 27522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:46:34.971946 27522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:45421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=39137
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:34.972913 27522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:34.973881 27522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:34.983088 27549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:34.983088 27552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:34.983119 27550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:34.984422 27522 server_base.cc:1034] running on GCE node
I20260807 18:46:34.984860 27522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:34.985523 27522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:34.986704 27522 hybrid_clock.cc:648] HybridClock initialized: now 1786128394986683 us; error 32 us; skew 500 ppm
Aug 07 18:46:34 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128394, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:34.989670 27522 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:46:34.990767 27522 webserver.cc:460] Webserver started at http://127.10.174.193:39137/ using document root <none> and password file <none>
I20260807 18:46:34.991510 27522 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:34.991631 27522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:34.996744 27522 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 18:46:34.999454 27559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.000892 27522 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:46:35.001016 27522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "5c96194164394d87836a66264ef81f00"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "5f0920c265ceb603659ed5002b1eb78d"
server_key_iv: "15bcdc97182b437a1b0bf344e819fe4e"
server_key_version: "encryptionkey@0"
I20260807 18:46:35.001750 27522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:35.016165 27522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:35.019541 27522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:35.019717 27522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:35.020457 27522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:35.021766 27567 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 18:46:35.025631 27522 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 18:46:35.025701 27522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260807 18:46:35.025760 27522 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 18:46:35.027796 27522 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 18:46:35.027849 27522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:35.028194 27567 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Bootstrap starting.
I20260807 18:46:35.038093 27522 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:45421
I20260807 18:46:35.038136 27677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:45421 every 8 connection(s)
I20260807 18:46:35.038990 27522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:46:35.041263 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 27522
I20260807 18:46:35.041795 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:42313
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:38413
--webserver_port=36769
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:46:35.048820 27567 log.cc:824] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:46:35 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128394, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:46:35.057018 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.041146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:56107 (local address 127.10.174.254:38413)
0807 18:46:35.041732 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.041757 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.042522 (+ 765us) server_negotiation.cc:407] Connection header received
0807 18:46:35.044072 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.044088 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.044486 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.044948 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:35.046384 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.047451 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.048682 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.049189 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.049380 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.052150 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:35.052155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:35.052166 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:35.052192 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:35.053903 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.054442 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.054448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.054452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.054574 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.054922 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.054926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.054928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.055254 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:35.055429 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.055940 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.056191 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":110,"threads_started":1}
I20260807 18:46:35.057032 27681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.041165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:56107)
0807 18:46:35.042327 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.042382 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.043582 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.045019 (+ 1437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.045032 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.045510 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:35.046190 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.046217 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.047602 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.047605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.048551 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.048562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.049600 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.049606 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.049814 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.050426 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:35.050442 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:35.051951 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:35.054030 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.054036 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.054056 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.054315 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.054675 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.054680 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.054682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.054821 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.055408 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:35.055414 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:35.055652 (+ 238us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.055831 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.056164 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"thread_start_us":154,"threads_started":1}
I20260807 18:46:35.058054 27567 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:46:35.058471 27567 tablet_bootstrap.cc:492] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Bootstrap complete.
I20260807 18:46:35.059619 27678 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38413
I20260807 18:46:35.059842 27678 heartbeater.cc:464] Registering TS with master...
I20260807 18:46:35.059942 27567 ts_tablet_manager.cc:1397] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.015s
I20260807 18:46:35.060351 27678 heartbeater.cc:511] Master 127.10.174.254:38413 requested a full tablet report, sending...
I20260807 18:46:35.062493 27483 ts_manager.cc:194] Registered new tserver with Master: 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421)
I20260807 18:46:35.062664 27567 raft_consensus.cc:348] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:35.063166 27567 raft_consensus.cc:729] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c96194164394d87836a66264ef81f00, State: Initialized, Role: FOLLOWER
I20260807 18:46:35.063685 27567 consensus_queue.cc:260] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } } peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } }
I20260807 18:46:35.064810 27567 ts_tablet_manager.cc:1428] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:46:35.066223 27483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:56107
I20260807 18:46:35.068970 27678 heartbeater.cc:503] Master 127.10.174.254:38413 was elected leader, sending a full tablet report...
Aug 07 18:46:35 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128394, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.193@KRBTEST.COM
I20260807 18:46:35.076277 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.065658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:45421 (local address 127.0.0.1:49906)
0807 18:46:35.066421 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.066464 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.066597 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.067144 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.067149 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.067626 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:35.067750 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.067758 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.069158 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.069162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.069834 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.069844 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.070432 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.070435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.070546 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.071136 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:35.071154 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:35.072595 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:35.074502 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.074510 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.074515 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.074746 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.075049 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.075052 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.075054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.075141 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.075652 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:35.075658 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:35.075778 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.075916 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.076102 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":111,"threads_started":1}
I20260807 18:46:35.076300 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.065750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49906 (local address 127.10.174.193:45421)
0807 18:46:35.066096 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.066109 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.066570 (+ 461us) server_negotiation.cc:407] Connection header received
0807 18:46:35.066739 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.066744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.066940 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.067099 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:35.067893 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.069016 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.069960 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.070297 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.070416 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.072735 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:35.072744 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:35.072755 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:35.072787 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:35.074374 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.074864 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.074870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.074876 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.074951 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.075234 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.075239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.075240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.075534 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:35.075674 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.075996 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.076158 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":102,"threads_started":1}
I20260807 18:46:35.077162 27610 tablet_service.cc:1514] Processing DeleteTablet for tablet 2719cf1be4fc48bda0d67ec0bde0aecf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:46:14 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:49906
I20260807 18:46:35.077960 27688 tablet_replica.cc:330] stopping tablet replica
I20260807 18:46:35.078312 27688 raft_consensus.cc:2229] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:46:35.078583 27688 raft_consensus.cc:2258] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:46:35.079564 27688 ts_tablet_manager.cc:1905] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:46:35.083467 27688 ts_tablet_manager.cc:1918] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:46:35.083545 27688 log.cc:1196] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal/wals/2719cf1be4fc48bda0d67ec0bde0aecf
I20260807 18:46:35.083817 27688 ts_tablet_manager.cc:1939] T 2719cf1be4fc48bda0d67ec0bde0aecf P 5c96194164394d87836a66264ef81f00: Deleting consensus metadata
I20260807 18:46:35.085304 27468 catalog_manager.cc:4841] TS 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421): tablet 2719cf1be4fc48bda0d67ec0bde0aecf (table test-table [id=d1d19ab7bcf54d67a599ac662cede251]) successfully deleted
W20260807 18:46:35.161016 27682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:35.161273 27682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:35.161345 27682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:35.165230 27682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:35.165307 27682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:35.165393 27682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:46:35.170444 27682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:42313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=36769
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:35.171373 27682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:35.172300 27682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:35.181617 27693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:35.181761 27682 server_base.cc:1034] running on GCE node
W20260807 18:46:35.181676 27696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:35.181624 27694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:35.182268 27682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:35.182854 27682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:35.184018 27682 hybrid_clock.cc:648] HybridClock initialized: now 1786128395183981 us; error 46 us; skew 500 ppm
Aug 07 18:46:35 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128395, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:35.186626 27682 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:46:35.187558 27682 webserver.cc:460] Webserver started at http://127.10.174.194:36769/ using document root <none> and password file <none>
I20260807 18:46:35.188084 27682 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:35.188189 27682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:35.191794 27682 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:46:35.193681 27703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.194911 27682 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:35.195061 27682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "14544263d3cd4afbb3d511078ce1058d"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "fa6582cb6b26f217fdee828a0a34adee"
server_key_iv: "a32f80da276b732d278115cc853b338b"
server_key_version: "encryptionkey@0"
I20260807 18:46:35.195667 27682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:35.222167 27682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:35.225169 27682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:35.225368 27682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:35.225944 27682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:35.226714 27682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:35.226789 27682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.226861 27682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:35.226912 27682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.235641 27682 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:42313
I20260807 18:46:35.235734 27822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:42313 every 8 connection(s)
I20260807 18:46:35.236560 27682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:46:35.242031 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 27682
I20260807 18:46:35.242497 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:39533
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:38413
--webserver_port=43801
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 18:46:35 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128395, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:46:35.251799 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.238337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:54789 (local address 127.10.174.254:38413)
0807 18:46:35.238481 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.238484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.239229 (+ 745us) server_negotiation.cc:407] Connection header received
0807 18:46:35.240560 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.240563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.240612 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.240686 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:35.241899 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.242512 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.244494 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.244918 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.245051 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.247602 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:35.247609 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:35.247613 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:35.247651 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:35.249503 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.250047 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.250053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.250054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.250154 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.250499 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.250506 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.250510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.250786 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:35.250904 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.251396 (+ 492us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.251551 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:46:35.252532 27825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.238608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:54789)
0807 18:46:35.239057 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.239099 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.240360 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.240851 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.240858 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.241212 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:35.241700 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.241715 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.242690 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.242697 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.244330 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.244345 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.245088 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.245091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.245249 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.245847 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:35.245864 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:35.247423 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:35.249646 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.249651 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.249661 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.249925 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.250256 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.250258 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.250259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.250389 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.250898 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:35.250902 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:35.251110 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.251258 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.251681 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":108,"threads_started":1}
I20260807 18:46:35.253852 27823 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38413
I20260807 18:46:35.254096 27823 heartbeater.cc:464] Registering TS with master...
I20260807 18:46:35.254562 27823 heartbeater.cc:511] Master 127.10.174.254:38413 requested a full tablet report, sending...
I20260807 18:46:35.255635 27483 ts_manager.cc:194] Registered new tserver with Master: 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313)
I20260807 18:46:35.256270 27483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:54789
W20260807 18:46:35.353354 27826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:35.353575 27826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:35.353655 27826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:35.357511 27826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:35.357589 27826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:35.357707 27826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:46:35.362612 27826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:39533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=43801
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:35.363530 27826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:35.364450 27826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:35.373374 27832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:35.373385 27831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:35.373380 27834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:35.373626 27826 server_base.cc:1034] running on GCE node
I20260807 18:46:35.374056 27826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:35.374620 27826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:35.375878 27826 hybrid_clock.cc:648] HybridClock initialized: now 1786128395375865 us; error 26 us; skew 500 ppm
Aug 07 18:46:35 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128395, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:35.378883 27826 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:46:35.379840 27826 webserver.cc:460] Webserver started at http://127.10.174.195:43801/ using document root <none> and password file <none>
I20260807 18:46:35.380360 27826 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:35.380497 27826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:35.383991 27826 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:46:35.385984 27841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.387130 27826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:35.387219 27826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "f7cc64d70f7347bda528232fe00b1452"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "e97246698831a692fe88b8cacc0b2643"
server_key_iv: "3a5fd4b3dd15536def51d5dc22657841"
server_key_version: "encryptionkey@0"
I20260807 18:46:35.387777 27826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:35.405509 27826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:35.409086 27826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:35.409288 27826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:35.409878 27826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:35.410682 27826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:35.410750 27826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.410822 27826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:35.410873 27826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:35.419751 27826 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39533
I20260807 18:46:35.419795 27961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39533 every 8 connection(s)
I20260807 18:46:35.420698 27826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:46:35.429733 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 27826
Aug 07 18:46:35 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128395, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:46:35.434372 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.422424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:54607 (local address 127.10.174.254:38413)
0807 18:46:35.422583 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.422588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.423940 (+ 1352us) server_negotiation.cc:407] Connection header received
0807 18:46:35.424778 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.424780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.424828 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.424904 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:35.426016 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.426530 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.427684 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.427917 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.428002 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.430698 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:35.430703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:35.430706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:35.430730 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:35.432310 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.432843 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.432847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.432848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.432935 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.433286 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.433291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.433293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.433481 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:35.433591 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.434077 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.434205 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:46:35.435163 27964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.422802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:54607)
0807 18:46:35.423790 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.423832 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.424592 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.425062 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.425068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.425420 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:35.425889 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.425902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.426633 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.426636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.427577 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.427586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.428056 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.428058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.428204 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.428839 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:35.428855 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:35.430533 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:35.432441 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.432447 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.432460 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.432732 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.433028 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:35.433033 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:35.433035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:35.433178 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:35.433591 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:35.433599 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:35.433844 (+ 245us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.434033 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.434351 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"thread_start_us":633,"threads_started":1}
I20260807 18:46:35.436568 27962 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38413
I20260807 18:46:35.436848 27962 heartbeater.cc:464] Registering TS with master...
I20260807 18:46:35.437402 27962 heartbeater.cc:511] Master 127.10.174.254:38413 requested a full tablet report, sending...
I20260807 18:46:35.438486 27483 ts_manager.cc:194] Registered new tserver with Master: f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
I20260807 18:46:35.439044 27483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:54607
I20260807 18:46:35.439635 27966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.430481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.10.174.254:38413)
0807 18:46:35.430804 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.430808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.430845 (+ 37us) server_negotiation.cc:407] Connection header received
0807 18:46:35.430977 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.430981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.431038 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.431137 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:35.431943 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.432469 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.433384 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.433621 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.433735 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.435180 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:35.435188 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:35.435191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:35.435234 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:35.436963 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.437362 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.437365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.437367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.437458 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.437784 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.437786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.437788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.437987 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:35.438222 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.439348 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.439470 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":73,"threads_started":1}
I20260807 18:46:35.441519 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:46:35.445322 27966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.442130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54298 (local address 127.10.174.254:38413)
0807 18:46:35.442252 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.442259 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.442462 (+ 203us) server_negotiation.cc:407] Connection header received
0807 18:46:35.442589 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.442591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.442684 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.442764 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:46:35.442969 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.443492 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.444388 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.444596 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.444681 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.444946 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:46:35.445056 (+ 110us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 18:46:35.445241 (+ 185us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54298: token expired
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 18:46:35.445400 27966 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54298: token expired
W20260807 18:46:35.445870 27408 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.174.254:38413)
I20260807 18:46:35.453085 27966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.446215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.10.174.254:38413)
0807 18:46:35.446345 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.446351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.446364 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:46:35.446487 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.446491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.446528 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.446618 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:35.447195 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.447733 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.448519 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.448751 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.448855 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.450080 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:35.450084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:35.450086 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:35.450110 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:35.451422 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.451829 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.451833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.451835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.451920 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:35.452195 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:35.452199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:35.452201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:35.452376 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:35.452569 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.452821 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.452938 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:46:35.455753 27483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:46:35.459169 27483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:46:35.467546 27610 tablet_service.cc:1467] Processing CreateTablet for tablet 776e15aa05d44a1a94647bbae2642cbc (DEFAULT_TABLE table=test-table [id=82787046ca8045c5a44d493342af7ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:46:35.468223 27610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 776e15aa05d44a1a94647bbae2642cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:35.470881 27567 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Bootstrap starting.
I20260807 18:46:35.471812 27567 tablet_bootstrap.cc:654] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:35.473019 27972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.466585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39533 (local address 127.0.0.1:50498)
0807 18:46:35.466841 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.466856 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.466947 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.468158 (+ 1211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.468161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.468180 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:35.468273 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.468280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.469687 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.469690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.471404 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.471416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.472514 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.472521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.472619 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.472678 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.472770 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.472865 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":117,"thread_start_us":93,"threads_started":1}
I20260807 18:46:35.473237 27567 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: No bootstrap required, opened a new log
I20260807 18:46:35.473330 27567 ts_tablet_manager.cc:1397] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:35.473393 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.466482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55642 (local address 127.10.174.194:42313)
0807 18:46:35.467484 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.467495 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.467516 (+ 21us) server_negotiation.cc:407] Connection header received
0807 18:46:35.467587 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.467591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.467805 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.468326 (+ 521us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:35.468515 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.469467 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.471611 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.472658 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.472818 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.472935 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.473036 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.473247 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":900,"thread_start_us":145,"threads_started":1}
I20260807 18:46:35.473464 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.467004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.10.174.195:39533)
0807 18:46:35.467445 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.467458 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.467483 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:46:35.467563 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.467570 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.467797 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.467975 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:35.468444 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.469570 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.471559 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.472376 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.472508 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.472639 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.473207 (+ 568us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.473311 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":163,"threads_started":1}
I20260807 18:46:35.473213 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.466304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42313 (local address 127.0.0.1:55642)
0807 18:46:35.466453 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.466478 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.466582 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.468005 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.468009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.468043 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:35.468170 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.468178 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.469599 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.469607 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.471449 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.471460 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.472815 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.472819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.472913 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.472934 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.473009 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.473096 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":67}
I20260807 18:46:35.473843 27567 raft_consensus.cc:348] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.473933 27567 raft_consensus.cc:374] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:35.473958 27567 raft_consensus.cc:729] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c96194164394d87836a66264ef81f00, State: Initialized, Role: FOLLOWER
I20260807 18:46:35.474094 27567 consensus_queue.cc:260] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.474324 27567 ts_tablet_manager.cc:1428] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 18:46:35.476516 27892 tablet_service.cc:1467] Processing CreateTablet for tablet 776e15aa05d44a1a94647bbae2642cbc (DEFAULT_TABLE table=test-table [id=82787046ca8045c5a44d493342af7ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:46:35.476982 27751 tablet_service.cc:1467] Processing CreateTablet for tablet 776e15aa05d44a1a94647bbae2642cbc (DEFAULT_TABLE table=test-table [id=82787046ca8045c5a44d493342af7ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:46:35.477629 27892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 776e15aa05d44a1a94647bbae2642cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:35.478008 27751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 776e15aa05d44a1a94647bbae2642cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:46:35.484364 27976 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Bootstrap starting.
I20260807 18:46:35.484364 27975 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Bootstrap starting.
I20260807 18:46:35.486549 27976 tablet_bootstrap.cc:654] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:35.486565 27975 tablet_bootstrap.cc:654] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Neither blocks nor log segments found. Creating new log.
I20260807 18:46:35.487262 27976 log.cc:824] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:35.487334 27975 log.cc:824] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:35.489001 27975 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: No bootstrap required, opened a new log
I20260807 18:46:35.489082 27976 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: No bootstrap required, opened a new log
I20260807 18:46:35.489216 27975 ts_tablet_manager.cc:1397] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:46:35.489259 27976 ts_tablet_manager.cc:1397] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:46:35.492230 27975 raft_consensus.cc:348] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.492269 27976 raft_consensus.cc:348] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.492465 27975 raft_consensus.cc:374] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:35.492457 27976 raft_consensus.cc:374] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:46:35.492547 27975 raft_consensus.cc:729] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14544263d3cd4afbb3d511078ce1058d, State: Initialized, Role: FOLLOWER
I20260807 18:46:35.492545 27976 raft_consensus.cc:729] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7cc64d70f7347bda528232fe00b1452, State: Initialized, Role: FOLLOWER
I20260807 18:46:35.492985 27975 consensus_queue.cc:260] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.492985 27976 consensus_queue.cc:260] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.493642 27962 heartbeater.cc:503] Master 127.10.174.254:38413 was elected leader, sending a full tablet report...
I20260807 18:46:35.493641 27823 heartbeater.cc:503] Master 127.10.174.254:38413 was elected leader, sending a full tablet report...
I20260807 18:46:35.494004 27976 ts_tablet_manager.cc:1428] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:46:35.494881 27975 ts_tablet_manager.cc:1428] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 18:46:35.540220 27679 tablet.cc:2369] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:46:35.587517 27980 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:35.587756 27980 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.588927 27980 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533), 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421)
I20260807 18:46:35.593415 27983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.589268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:40999 (local address 127.10.174.193:45421)
0807 18:46:35.589510 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.589513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.589623 (+ 110us) server_negotiation.cc:407] Connection header received
0807 18:46:35.589798 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.589801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.589875 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.589978 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:35.590337 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.591084 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.592462 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.592896 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.593027 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.593197 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.593234 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.593301 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":71,"threads_started":1}
I20260807 18:46:35.593426 27982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.589156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:45421 (local address 127.10.174.194:40999)
0807 18:46:35.589537 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.589552 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.589643 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.589995 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.589997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.590010 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:35.590165 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.590171 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.591221 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.591225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.592328 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.592337 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.593018 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.593022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.593112 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.593135 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.593199 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.593271 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":249,"thread_start_us":105,"threads_started":1}
I20260807 18:46:35.593497 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.589284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:34637 (local address 127.10.174.195:39533)
0807 18:46:35.589426 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.589430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.589447 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:46:35.589633 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.589638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.589790 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.589884 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:46:35.590198 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.591098 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.592528 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.592927 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.593053 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.593110 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.593300 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.593372 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 18:46:35.593510 27825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.589157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39533 (local address 127.10.174.194:34637)
0807 18:46:35.589385 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.589400 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:35.589490 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:35.589900 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:35.589902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:35.589916 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:46:35.590080 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.590090 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.591221 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.591225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.592384 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:35.592396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.593053 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.593057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:35.593176 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.593196 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 18:46:35.593286 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 18:46:35.593354 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":50}
I20260807 18:46:35.594120 27913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776e15aa05d44a1a94647bbae2642cbc" candidate_uuid: "14544263d3cd4afbb3d511078ce1058d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7cc64d70f7347bda528232fe00b1452" is_pre_election: true
I20260807 18:46:35.594197 27631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776e15aa05d44a1a94647bbae2642cbc" candidate_uuid: "14544263d3cd4afbb3d511078ce1058d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c96194164394d87836a66264ef81f00" is_pre_election: true
I20260807 18:46:35.594431 27631 raft_consensus.cc:2454] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14544263d3cd4afbb3d511078ce1058d in term 0.
I20260807 18:46:35.594432 27913 raft_consensus.cc:2454] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14544263d3cd4afbb3d511078ce1058d in term 0.
I20260807 18:46:35.594909 27705 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14544263d3cd4afbb3d511078ce1058d, 5c96194164394d87836a66264ef81f00; no voters:
I20260807 18:46:35.595196 27980 raft_consensus.cc:2781] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:46:35.595331 27980 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:46:35.595396 27980 raft_consensus.cc:3037] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:35.596405 27980 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.596736 27980 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [CANDIDATE]: Term 1 election: Requested vote from peers f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533), 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421)
I20260807 18:46:35.597079 27631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776e15aa05d44a1a94647bbae2642cbc" candidate_uuid: "14544263d3cd4afbb3d511078ce1058d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c96194164394d87836a66264ef81f00"
I20260807 18:46:35.597208 27631 raft_consensus.cc:3037] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:35.598240 27631 raft_consensus.cc:2454] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14544263d3cd4afbb3d511078ce1058d in term 1.
I20260807 18:46:35.598510 27913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776e15aa05d44a1a94647bbae2642cbc" candidate_uuid: "14544263d3cd4afbb3d511078ce1058d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7cc64d70f7347bda528232fe00b1452"
I20260807 18:46:35.598552 27705 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14544263d3cd4afbb3d511078ce1058d, 5c96194164394d87836a66264ef81f00; no voters:
I20260807 18:46:35.598649 27913 raft_consensus.cc:3037] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:46:35.598721 27980 raft_consensus.cc:2781] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:46:35.598925 27980 raft_consensus.cc:686] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 1 LEADER]: Becoming Leader. State: Replica: 14544263d3cd4afbb3d511078ce1058d, State: Running, Role: LEADER
I20260807 18:46:35.599256 27980 consensus_queue.cc:237] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:35.600008 27913 raft_consensus.cc:2454] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14544263d3cd4afbb3d511078ce1058d in term 1.
I20260807 18:46:35.602643 27482 catalog_manager.cc:5495] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d reported cstate change: term changed from 0 to 1, leader changed from <none> to 14544263d3cd4afbb3d511078ce1058d (127.10.174.194). New cstate: current_term: 1 leader_uuid: "14544263d3cd4afbb3d511078ce1058d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } health_report { overall_health: UNKNOWN } } }
I20260807 18:46:35.623790 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.619843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55646 (local address 127.10.174.194:42313)
0807 18:46:35.619986 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:35.619990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:35.620004 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:46:35.620174 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:35.620178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:35.620241 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:35.620351 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:46:35.620609 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.621519 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.622323 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:35.622556 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:35.622664 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:35.622962 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:46:35.623411 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:46:35.623534 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:35.623596 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 18:46:35.623649 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:46:35.629454 27631 raft_consensus.cc:1261] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Refusing update from remote peer 14544263d3cd4afbb3d511078ce1058d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:46:35.629459 27913 raft_consensus.cc:1261] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Refusing update from remote peer 14544263d3cd4afbb3d511078ce1058d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:46:35.630131 27984 consensus_queue.cc:1035] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:46:35.630316 27980 consensus_queue.cc:1035] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:46:35.635573 27987 mvcc.cc:205] Tried to move back new op lower bound from 7315981908491472896 to 7315981908377710592. Current Snapshot: MvccSnapshot[applied={T|T < 7315981908491472896}]
I20260807 18:46:35.638305 27988 mvcc.cc:205] Tried to move back new op lower bound from 7315981908491472896 to 7315981908377710592. Current Snapshot: MvccSnapshot[applied={T|T < 7315981908491472896}]
I20260807 18:46:35.638643 27989 mvcc.cc:205] Tried to move back new op lower bound from 7315981908491472896 to 7315981908377710592. Current Snapshot: MvccSnapshot[applied={T|T < 7315981908491472896}]
I20260807 18:46:35.644342 27481 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:46:35.644507 27481 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:46:35.646823 27481 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Sending DeleteTablet for 3 replicas of tablet 776e15aa05d44a1a94647bbae2642cbc
I20260807 18:46:35.647492 27892 tablet_service.cc:1514] Processing DeleteTablet for tablet 776e15aa05d44a1a94647bbae2642cbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:46:35 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:50498
I20260807 18:46:35.647538 27751 tablet_service.cc:1514] Processing DeleteTablet for tablet 776e15aa05d44a1a94647bbae2642cbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:46:35 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:55642
I20260807 18:46:35.647912 27610 tablet_service.cc:1514] Processing DeleteTablet for tablet 776e15aa05d44a1a94647bbae2642cbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:46:35 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:49906
I20260807 18:46:35.647964 27999 tablet_replica.cc:330] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: stopping tablet replica
I20260807 18:46:35.648193 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 27522
I20260807 18:46:35.648252 28000 tablet_replica.cc:330] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: stopping tablet replica
I20260807 18:46:35.648392 28000 raft_consensus.cc:2229] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:46:35.648524 28000 raft_consensus.cc:2258] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:46:35.648511 27999 raft_consensus.cc:2229] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:46:35.651582 27999 raft_consensus.cc:2258] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:46:35.653007 27999 ts_tablet_manager.cc:1905] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:46:35.655689 27999 ts_tablet_manager.cc:1918] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:46:35.655783 27999 log.cc:1196] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/776e15aa05d44a1a94647bbae2642cbc
I20260807 18:46:35.655844 27998 tablet_replica.cc:330] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: stopping tablet replica
I20260807 18:46:35.656140 27999 ts_tablet_manager.cc:1939] T 776e15aa05d44a1a94647bbae2642cbc P 14544263d3cd4afbb3d511078ce1058d: Deleting consensus metadata
I20260807 18:46:35.656152 27998 raft_consensus.cc:2229] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:46:35.656440 27998 raft_consensus.cc:2258] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:46:35.657186 27468 catalog_manager.cc:4841] TS 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): tablet 776e15aa05d44a1a94647bbae2642cbc (table test-table [id=82787046ca8045c5a44d493342af7ea2]) successfully deleted
I20260807 18:46:35.657773 27998 ts_tablet_manager.cc:1905] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:46:35.661109 27998 ts_tablet_manager.cc:1918] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:46:35.661211 27998 log.cc:1196] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/776e15aa05d44a1a94647bbae2642cbc
I20260807 18:46:35.661592 27998 ts_tablet_manager.cc:1939] T 776e15aa05d44a1a94647bbae2642cbc P f7cc64d70f7347bda528232fe00b1452: Deleting consensus metadata
I20260807 18:46:35.662706 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 27682
I20260807 18:46:35.662777 27469 catalog_manager.cc:4841] TS f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): tablet 776e15aa05d44a1a94647bbae2642cbc (table test-table [id=82787046ca8045c5a44d493342af7ea2]) successfully deleted
W20260807 18:46:35.662825 27468 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:45421 (error 108)
I20260807 18:46:35.664436 27972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:35.664048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:45421 (local address 127.0.0.1:49914)
0807 18:46:35.664248 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:35.664336 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:45421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260807 18:46:35.664595 27468 catalog_manager.cc:4584] TS 5c96194164394d87836a66264ef81f00 (127.10.174.193:45421): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 776e15aa05d44a1a94647bbae2642cbc: Network error: Client connection negotiation failed: client connection to 127.10.174.193:45421: connect: Connection refused (error 111)
I20260807 18:46:35.669255 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 27826
I20260807 18:46:35.675575 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 27450
I20260807 18:46:55.683040 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38413
--webserver_interface=127.10.174.254
--webserver_port=46519
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:55.794116 28002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:55.794399 28002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:55.794471 28002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:55.798600 28002 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 18:46:55.798698 28002 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 18:46:55.798735 28002 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 18:46:55.798787 28002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:46:55.798830 28002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:55.798887 28002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:55.798926 28002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:46:55.798964 28002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:46:55.804204 28002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=46519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:55.805204 28002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:55.806233 28002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:55.814916 28010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:55.814970 28002 server_base.cc:1034] running on GCE node
W20260807 18:46:55.814914 28008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:55.814891 28007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:55.815672 28002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:55.816668 28002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:55.817850 28002 hybrid_clock.cc:648] HybridClock initialized: now 1786128415817821 us; error 43 us; skew 500 ppm
Aug 07 18:46:55 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128415, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:55.820580 28002 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:46:55.821381 28002 webserver.cc:460] Webserver started at http://127.10.174.254:46519/ using document root <none> and password file <none>
I20260807 18:46:55.821918 28002 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:55.822009 28002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:55.825734 28002 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:46:55.827970 28018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:55.829170 28002 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:46:55.829308 28002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "e4ac360e8df048368de397e384ae58f5"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "94d32b180c210b854d4a27aa5f4c702d"
server_key_iv: "5ba4229e161d1fa68ef32e3b990a0843"
server_key_version: "encryptionkey@0"
I20260807 18:46:55.829891 28002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:55.849514 28002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:55.852308 28002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:55.852517 28002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:55.859678 28002 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38413
I20260807 18:46:55.860018 28070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38413 every 8 connection(s)
I20260807 18:46:55.860769 28002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:46:55.864938 28071 sys_catalog.cc:263] Verifying existing consensus state
I20260807 18:46:55.866583 28071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap starting.
I20260807 18:46:55.870582 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28002
I20260807 18:46:55.871100 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:45421
--local_ip_for_outbound_sockets=127.10.174.193
--tserver_master_addrs=127.10.174.254:38413
--webserver_port=39137
--webserver_interface=127.10.174.193
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:46:55.885999 28071 log.cc:824] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:55.897576 28071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:46:55.897971 28071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Bootstrap complete.
I20260807 18:46:55.902107 28071 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:55.902526 28071 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4ac360e8df048368de397e384ae58f5, State: Initialized, Role: FOLLOWER
I20260807 18:46:55.903026 28071 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:55.903182 28071 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:46:55.903277 28071 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:46:55.903434 28071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 2 FOLLOWER]: Advancing to term 3
I20260807 18:46:55.905318 28071 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:55.905653 28071 leader_election.cc:302] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4ac360e8df048368de397e384ae58f5; no voters:
I20260807 18:46:55.906042 28071 leader_election.cc:288] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 18:46:55.906152 28075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 18:46:55.906394 28075 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [term 3 LEADER]: Becoming Leader. State: Replica: e4ac360e8df048368de397e384ae58f5, State: Running, Role: LEADER
I20260807 18:46:55.906752 28075 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } }
I20260807 18:46:55.907330 28071 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:46:55.908258 28076 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e4ac360e8df048368de397e384ae58f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } } }
I20260807 18:46:55.908382 28076 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:46:55.909113 28077 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4ac360e8df048368de397e384ae58f5. Latest consensus state: current_term: 3 leader_uuid: "e4ac360e8df048368de397e384ae58f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4ac360e8df048368de397e384ae58f5" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38413 } } }
I20260807 18:46:55.909205 28077 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5 [sys.catalog]: This master's current role is: LEADER
I20260807 18:46:55.909379 28086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:46:55.914403 28086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:46:55.915123 28086 catalog_manager.cc:1259] Loaded cluster ID: e5f8a8c2f1aa47fd8caadcbf020e127b
I20260807 18:46:55.915187 28086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:46:55.917860 28086 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:46:55.918555 28086 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Loaded TSK: 0
I20260807 18:46:55.918635 28086 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e4ac360e8df048368de397e384ae58f5: Loaded TSK: 1
F20260807 18:46:55.919369 28086 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f13565d59ad google::LogMessage::Fail() at ??:0
@ 0x7f13565d888a google::LogMessage::SendToLog() at ??:0
@ 0x7f13565d54de google::LogMessage::Flush() at ??:0
@ 0x7f13565d6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f135929918d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1359291f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1360f3a7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1360f1499c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1360f15178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f1360f56df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f1360f7582b std::function<>::operator()() at ??:0
@ 0x7f1360f14b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f1360f15f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1360f12579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f1360f56640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f13588273d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1358827c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f13588293f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1358818512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1359e5c6db start_thread at ??:0
@ 0x7f13550d361f clone at ??:0
W20260807 18:46:56.024099 28073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:56.024377 28073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:56.024423 28073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:56.028833 28073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:56.028898 28073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:56.028987 28073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:46:56.034391 28073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:45421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=39137
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:56.035578 28073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:56.036641 28073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:56.047005 28123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:56.047163 28124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:56.047008 28126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:56.047339 28073 server_base.cc:1034] running on GCE node
I20260807 18:46:56.047972 28073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:56.048664 28073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:56.049850 28073 hybrid_clock.cc:648] HybridClock initialized: now 1786128416049836 us; error 37 us; skew 500 ppm
Aug 07 18:46:56 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128416, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:56.052769 28073 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:46:56.053649 28073 webserver.cc:460] Webserver started at http://127.10.174.193:39137/ using document root <none> and password file <none>
I20260807 18:46:56.054214 28073 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:56.054309 28073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:56.058432 28073 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:46:56.060842 28134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.062145 28073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 18:46:56.062284 28073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "5c96194164394d87836a66264ef81f00"
format_stamp: "Formatted at 2026-08-07 18:46:13 on dist-test-slave-07c2"
server_key: "5f0920c265ceb603659ed5002b1eb78d"
server_key_iv: "15bcdc97182b437a1b0bf344e819fe4e"
server_key_version: "encryptionkey@0"
I20260807 18:46:56.062839 28073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:56.081983 28073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:56.085505 28073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:56.085723 28073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:56.086351 28073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:56.087512 28141 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 18:46:56.091682 28073 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 18:46:56.091751 28073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.001s
I20260807 18:46:56.091822 28073 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 18:46:56.093441 28073 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 18:46:56.093497 28073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 18:46:56.093755 28141 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Bootstrap starting.
I20260807 18:46:56.104615 28073 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:45421
I20260807 18:46:56.105432 28252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:45421 every 8 connection(s)
I20260807 18:46:56.105949 28073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:46:56.109488 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28073
I20260807 18:46:56.110002 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:42313
--local_ip_for_outbound_sockets=127.10.174.194
--tserver_master_addrs=127.10.174.254:38413
--webserver_port=36769
--webserver_interface=127.10.174.194
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:46:56.115597 28141 log.cc:824] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Log is configured to *not* fsync() on all Append() calls
I20260807 18:46:56.126124 28141 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 18:46:56.126580 28141 tablet_bootstrap.cc:492] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Bootstrap complete.
I20260807 18:46:56.128144 28141 ts_tablet_manager.cc:1397] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.011s
I20260807 18:46:56.131412 28141 raft_consensus.cc:348] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:56.131961 28141 raft_consensus.cc:729] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c96194164394d87836a66264ef81f00, State: Initialized, Role: FOLLOWER
I20260807 18:46:56.132472 28141 consensus_queue.cc:260] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:56.133517 28141 ts_tablet_manager.cc:1428] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260807 18:46:56.155224 28255 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:46:56.108850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:54247)
0807 18:46:56.111676 (+ 2826us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.111748 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:56.112915 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:56.154409 (+ 41494us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":2549,"thread_start_us":207,"threads_started":1}
W20260807 18:46:56.155926 28253 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:38413 (0 consecutive failures): Network error: Failed to ping master at 127.10.174.254:38413: Client connection negotiation failed: client connection to 127.10.174.254:38413: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 18:46:56.156702 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.156424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:33997)
0807 18:46:56.156564 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.156645 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 18:46:56.157404 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.157188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:57345)
0807 18:46:56.157297 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.157346 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 18:46:56.157617 28253 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 18:46:56.236515 28256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:56.236846 28256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:56.236924 28256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:56.241096 28256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:56.241209 28256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:56.241310 28256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:46:56.246863 28256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:42313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=36769
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:56.248083 28256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:56.249164 28256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:56.258608 28266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:56.258633 28264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:56.258747 28256 server_base.cc:1034] running on GCE node
W20260807 18:46:56.258610 28263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:56.259449 28256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:56.260062 28256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:56.261225 28256 hybrid_clock.cc:648] HybridClock initialized: now 1786128416261190 us; error 47 us; skew 500 ppm
Aug 07 18:46:56 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128416, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:56.264035 28256 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:46:56.264899 28256 webserver.cc:460] Webserver started at http://127.10.174.194:36769/ using document root <none> and password file <none>
I20260807 18:46:56.265430 28256 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:56.265489 28256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:56.269680 28256 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 18:46:56.271811 28273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.273092 28256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:46:56.273217 28256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "14544263d3cd4afbb3d511078ce1058d"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "fa6582cb6b26f217fdee828a0a34adee"
server_key_iv: "a32f80da276b732d278115cc853b338b"
server_key_version: "encryptionkey@0"
I20260807 18:46:56.273756 28256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:56.296797 28256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:56.300411 28256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:56.300621 28256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:56.301263 28256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:56.302130 28256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:56.302203 28256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.302276 28256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:56.302325 28256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.311219 28256 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:42313
I20260807 18:46:56.311259 28390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:42313 every 8 connection(s)
I20260807 18:46:56.312251 28256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:46:56.315974 28393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.314337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:50141)
0807 18:46:56.314799 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.315223 (+ 424us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":122,"threads_started":1}
W20260807 18:46:56.316450 28391 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:38413 (0 consecutive failures): Network error: Failed to ping master at 127.10.174.254:38413: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
I20260807 18:46:56.317049 28393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.316844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:50541)
0807 18:46:56.316949 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.316998 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 18:46:56.317628 28393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.317453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:56631)
0807 18:46:56.317543 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.317583 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 18:46:56.317806 28391 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 18:46:56.320816 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28256
I20260807 18:46:56.321244 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:39533
--local_ip_for_outbound_sockets=127.10.174.195
--tserver_master_addrs=127.10.174.254:38413
--webserver_port=43801
--webserver_interface=127.10.174.195
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:46:56.432056 28394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:46:56.432358 28394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:46:56.432435 28394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:46:56.436442 28394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:46:56.436532 28394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:46:56.436627 28394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:46:56.441843 28394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:39533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=43801
--tserver_master_addrs=127.10.174.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:46:56.442919 28394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:46:56.443969 28394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:46:56.453238 28399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:56.453246 28402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:46:56.453258 28400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:46:56.453668 28394 server_base.cc:1034] running on GCE node
I20260807 18:46:56.454101 28394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:46:56.454870 28394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:46:56.456053 28394 hybrid_clock.cc:648] HybridClock initialized: now 1786128416456027 us; error 37 us; skew 500 ppm
Aug 07 18:46:56 dist-test-slave-07c2 krb5kdc[26879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128416, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:46:56.458807 28394 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:46:56.459667 28394 webserver.cc:460] Webserver started at http://127.10.174.195:43801/ using document root <none> and password file <none>
I20260807 18:46:56.460171 28394 fs_manager.cc:359] Metadata directory not provided
I20260807 18:46:56.460229 28394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:46:56.464193 28394 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:46:56.466105 28410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.467480 28394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:46:56.467648 28394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "f7cc64d70f7347bda528232fe00b1452"
format_stamp: "Formatted at 2026-08-07 18:46:14 on dist-test-slave-07c2"
server_key: "e97246698831a692fe88b8cacc0b2643"
server_key_iv: "3a5fd4b3dd15536def51d5dc22657841"
server_key_version: "encryptionkey@0"
I20260807 18:46:56.468196 28394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:46:56.482146 28394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:46:56.485368 28394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:46:56.485524 28394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:46:56.486045 28394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:46:56.486814 28394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:46:56.486861 28394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.486899 28394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:46:56.486920 28394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:46:56.495680 28394 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39533
I20260807 18:46:56.495711 28527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39533 every 8 connection(s)
I20260807 18:46:56.496668 28394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:46:56.498334 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28394
I20260807 18:46:56.500370 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.498628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:36177)
0807 18:46:56.499138 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.499696 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":115,"threads_started":1}
W20260807 18:46:56.500847 28528 heartbeater.cc:644] Failed to heartbeat to 127.10.174.254:38413 (0 consecutive failures): Network error: Failed to ping master at 127.10.174.254:38413: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
I20260807 18:46:56.501394 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.501195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:46843)
0807 18:46:56.501296 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.501340 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 18:46:56.501928 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:56.501753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:41943)
0807 18:46:56.501844 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:56.501883 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 18:46:56.502110 28528 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 18:46:57.158768 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.158283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:36835)
0807 18:46:57.158586 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:57.158649 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
I20260807 18:46:57.318684 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.318301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:34975)
0807 18:46:57.318531 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:57.318584 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":66,"threads_started":1}
I20260807 18:46:57.502996 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.502602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:49449)
0807 18:46:57.502854 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:57.502905 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260807 18:46:57.513346 28535 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:57.513545 28535 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:57.514602 28535 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313), f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
Aug 07 18:46:57 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128416, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.194@KRBTEST.COM
Aug 07 18:46:57 dist-test-slave-07c2 krb5kdc[26879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128416, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.195@KRBTEST.COM
I20260807 18:46:57.532647 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.514983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:51565 (local address 127.10.174.195:39533)
0807 18:46:57.515278 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:57.515342 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:57.515391 (+ 49us) server_negotiation.cc:407] Connection header received
0807 18:46:57.516046 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:57.516052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:57.516376 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:57.516666 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:57.517813 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.518768 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.520016 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.520601 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.520768 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:57.528357 (+ 7589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:57.528385 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:57.528402 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:57.528438 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:57.530240 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:57.530724 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:57.530730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:57.530735 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:57.530864 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:57.531233 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:57.531236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:57.531238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:57.531720 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:57.531816 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:57.532185 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 18:46:57.532466 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":89,"threads_started":1}
I20260807 18:46:57.532647 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.514941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:33975 (local address 127.10.174.194:42313)
0807 18:46:57.515383 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 18:46:57.515405 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 18:46:57.515445 (+ 40us) server_negotiation.cc:407] Connection header received
0807 18:46:57.516075 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:46:57.516080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:46:57.516374 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:46:57.516664 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:46:57.517822 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.518737 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.519986 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.520513 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.520692 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:57.528058 (+ 7366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:46:57.528063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:46:57.528074 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:46:57.528100 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:46:57.529876 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:57.530417 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:57.530421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:57.530425 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:57.530532 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:46:57.530941 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:46:57.530946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:46:57.530949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:46:57.531484 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:46:57.531616 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 18:46:57.532185 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 18:46:57.532466 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":101,"threads_started":1}
I20260807 18:46:57.532634 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.514762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:42313 (local address 127.10.174.193:33975)
0807 18:46:57.515263 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:57.515279 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:57.515385 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:57.516709 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:57.516714 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:57.517228 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:57.517648 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:57.517661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.518886 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.518894 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:57.519867 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:57.519876 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.520632 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.520636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:57.520798 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:57.526072 (+ 5274us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:57.526084 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:57.527834 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:57.530016 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:57.530021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:57.530034 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:57.530287 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:57.530632 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:57.530636 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:57.530638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:57.530821 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:57.531602 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:57.531607 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:57.531840 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 18:46:57.532034 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 18:46:57.532466 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":221,"spinlock_wait_cycles":8576}
I20260807 18:46:57.532634 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:57.514808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39533 (local address 127.10.174.193:51565)
0807 18:46:57.515112 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:57.515130 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:46:57.515251 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:46:57.516710 (+ 1459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:46:57.516716 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:46:57.517229 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:46:57.517649 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:57.517661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.518892 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.518897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:57.519876 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:46:57.519890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:46:57.520724 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:46:57.520727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:46:57.520811 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:46:57.526063 (+ 5252us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:46:57.526088 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:46:57.528154 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:46:57.530361 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:57.530366 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:57.530369 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:57.530614 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:57.531026 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:46:57.531029 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:46:57.531031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:46:57.531121 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:46:57.531821 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:46:57.531824 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:46:57.531894 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 18:46:57.532034 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 18:46:57.532414 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":118,"spinlock_wait_cycles":23168,"thread_start_us":75,"threads_started":1}
W20260807 18:46:57.535449 28137 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
W20260807 18:46:57.535636 28136 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
I20260807 18:46:57.535751 28136 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c96194164394d87836a66264ef81f00; no voters: 14544263d3cd4afbb3d511078ce1058d, f7cc64d70f7347bda528232fe00b1452
I20260807 18:46:57.536028 28535 raft_consensus.cc:2726] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:46:58.160107 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:58.159628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:52765)
0807 18:46:58.159950 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:58.160007 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":96,"threads_started":1}
I20260807 18:46:58.319921 28540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:58.319541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:39743)
0807 18:46:58.319768 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:58.319836 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":67,"threads_started":1}
I20260807 18:46:58.504283 28541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:58.503865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:43475)
0807 18:46:58.504119 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:58.504179 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":76,"threads_started":1}
I20260807 18:46:59.161353 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:59.160922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:53497)
0807 18:46:59.161186 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:59.161243 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260807 18:46:59.321067 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:59.320652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:47729)
0807 18:46:59.320901 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:59.320954 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":89,"threads_started":1}
I20260807 18:46:59.378647 28545 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:46:59.378863 28545 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:46:59.379503 28545 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313), f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
W20260807 18:46:59.380245 28136 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
W20260807 18:46:59.380332 28137 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
I20260807 18:46:59.380447 28137 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c96194164394d87836a66264ef81f00; no voters: 14544263d3cd4afbb3d511078ce1058d, f7cc64d70f7347bda528232fe00b1452
I20260807 18:46:59.380609 28545 raft_consensus.cc:2726] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:46:59.505479 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:46:59.505081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:57825)
0807 18:46:59.505324 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 18:46:59.505376 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
I20260807 18:47:00.162597 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:00.162104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:42313)
0807 18:47:00.162439 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:00.162499 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":74,"threads_started":1}
I20260807 18:47:00.322328 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:00.321868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:41609)
0807 18:47:00.322154 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:00.322235 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":95,"threads_started":1}
I20260807 18:47:00.506475 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:00.506098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:56663)
0807 18:47:00.506344 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:00.506391 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
I20260807 18:47:01.164019 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:01.163579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:45085)
0807 18:47:01.163862 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:01.163920 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":73,"threads_started":1}
I20260807 18:47:01.323737 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:01.323267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:45089)
0807 18:47:01.323589 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:01.323645 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":75,"threads_started":1}
I20260807 18:47:01.507670 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:01.507209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:55853)
0807 18:47:01.507523 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:01.507579 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":154,"threads_started":1}
I20260807 18:47:01.838294 28553 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:01.838451 28553 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:47:01.838939 28553 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313), f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
W20260807 18:47:01.839766 28137 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
W20260807 18:47:01.839871 28136 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
I20260807 18:47:01.839972 28136 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c96194164394d87836a66264ef81f00; no voters: 14544263d3cd4afbb3d511078ce1058d, f7cc64d70f7347bda528232fe00b1452
I20260807 18:47:01.840129 28553 raft_consensus.cc:2726] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:47:02.165326 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:02.164811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:51631)
0807 18:47:02.165133 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:02.165196 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":69,"threads_started":1}
I20260807 18:47:02.324862 28556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:02.324472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:38927)
0807 18:47:02.324716 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:02.324772 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260807 18:47:02.508924 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:02.508445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:42983)
0807 18:47:02.508771 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:02.508831 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":111,"threads_started":1}
I20260807 18:47:03.166659 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:03.166065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:42131)
0807 18:47:03.166500 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:03.166561 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":247,"threads_started":1}
I20260807 18:47:03.326102 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:03.325587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:56689)
0807 18:47:03.325933 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:03.326010 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":89,"threads_started":1}
I20260807 18:47:03.510092 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:03.509647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:48177)
0807 18:47:03.509949 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:03.510002 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":97,"threads_started":1}
I20260807 18:47:04.168052 28561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:04.167551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:41585)
0807 18:47:04.167840 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:04.167912 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":117,"threads_started":1}
I20260807 18:47:04.327653 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:04.327135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:56659)
0807 18:47:04.327486 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:04.327554 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":86,"threads_started":1}
I20260807 18:47:04.511448 28563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:04.510932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:35685)
0807 18:47:04.511213 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:04.511349 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
I20260807 18:47:04.624528 28564 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:04.624661 28564 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:47:04.625075 28564 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313), f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
W20260807 18:47:04.625834 28136 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
W20260807 18:47:04.625921 28137 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
I20260807 18:47:04.626034 28137 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c96194164394d87836a66264ef81f00; no voters: 14544263d3cd4afbb3d511078ce1058d, f7cc64d70f7347bda528232fe00b1452
I20260807 18:47:04.626227 28564 raft_consensus.cc:2726] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:47:05.169343 28565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:05.168887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:59563)
0807 18:47:05.169147 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:05.169236 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":101,"threads_started":1}
I20260807 18:47:05.328863 28566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:05.328421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:49861)
0807 18:47:05.328703 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:05.328767 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":78,"threads_started":1}
I20260807 18:47:05.512578 28567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:05.512163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:57561)
0807 18:47:05.512433 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:05.512486 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":107,"threads_started":1}
I20260807 18:47:06.170557 28569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:06.170125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:53309)
0807 18:47:06.170398 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:06.170456 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":89,"threads_started":1}
I20260807 18:47:06.330070 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:06.329660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:38743)
0807 18:47:06.329928 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:06.329979 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":117,"threads_started":1}
I20260807 18:47:06.513656 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:06.513280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:59535)
0807 18:47:06.513511 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:06.513564 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":71,"threads_started":1}
I20260807 18:47:07.171864 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:07.171392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:56839)
0807 18:47:07.171660 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:07.171748 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":71,"threads_started":1}
I20260807 18:47:07.331195 28573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:07.330801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:57775)
0807 18:47:07.331046 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:07.331103 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
I20260807 18:47:07.514962 28574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:07.514479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:46129)
0807 18:47:07.514779 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:07.514850 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":75,"threads_started":1}
I20260807 18:47:08.173003 28575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:08.172585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:36685)
0807 18:47:08.172850 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:08.172908 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":77,"threads_started":1}
I20260807 18:47:08.332347 28576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:08.331929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:59467)
0807 18:47:08.332196 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:08.332256 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":83,"threads_started":1}
I20260807 18:47:08.516320 28577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:08.515880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:40245)
0807 18:47:08.516151 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:08.516210 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":93,"threads_started":1}
I20260807 18:47:09.174134 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:09.173722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:53027)
0807 18:47:09.173983 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:09.174036 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":77,"threads_started":1}
I20260807 18:47:09.333513 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:09.333097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:55515)
0807 18:47:09.333362 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:09.333418 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":88,"threads_started":1}
I20260807 18:47:09.517422 28580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:09.517026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:49969)
0807 18:47:09.517261 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:09.517326 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":76,"threads_started":1}
I20260807 18:47:10.175382 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:10.174878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:58967)
0807 18:47:10.175161 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:10.175224 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":90,"threads_started":1}
I20260807 18:47:10.334693 28582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:10.334266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:57223)
0807 18:47:10.334544 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:10.334599 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":94,"threads_started":1}
I20260807 18:47:10.518616 28583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:10.518201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:55737)
0807 18:47:10.518461 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:10.518519 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":89,"threads_started":1}
I20260807 18:47:11.101382 28584 raft_consensus.cc:482] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:11.101516 28584 raft_consensus.cc:504] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14544263d3cd4afbb3d511078ce1058d" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 42313 } } peers { permanent_uuid: "f7cc64d70f7347bda528232fe00b1452" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39533 } } peers { permanent_uuid: "5c96194164394d87836a66264ef81f00" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 45421 } }
I20260807 18:47:11.101977 28584 leader_election.cc:288] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313), f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533)
W20260807 18:47:11.102785 28137 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f7cc64d70f7347bda528232fe00b1452 (127.10.174.195:39533): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
W20260807 18:47:11.102878 28136 leader_election.cc:341] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14544263d3cd4afbb3d511078ce1058d (127.10.174.194:42313): Not found: Tablet not found: 776e15aa05d44a1a94647bbae2642cbc
I20260807 18:47:11.102986 28136 leader_election.cc:302] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c96194164394d87836a66264ef81f00; no voters: 14544263d3cd4afbb3d511078ce1058d, f7cc64d70f7347bda528232fe00b1452
I20260807 18:47:11.103142 28584 raft_consensus.cc:2726] T 776e15aa05d44a1a94647bbae2642cbc P 5c96194164394d87836a66264ef81f00 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 18:47:11.176693 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:11.176304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.193:55495)
0807 18:47:11.176544 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:11.176596 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260807 18:47:11.336005 28586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:11.335602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.194:44693)
0807 18:47:11.335855 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:11.335910 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":87,"threads_started":1}
I20260807 18:47:11.507196 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28073
I20260807 18:47:11.514770 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28256
I20260807 18:47:11.520022 28587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:11.519603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38413 (local address 127.10.174.195:56081)
0807 18:47:11.519864 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:11.519931 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.254:38413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":96,"threads_started":1}
I20260807 18:47:11.521452 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28394
2026-08-07T18:47:11Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59146 ms)
[----------] 30 tests from SecurityITest (240528 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:11 dist-test-slave-07c2 krb5kdc[28590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:11 dist-test-slave-07c2 krb5kdc[28590](info): set up 2 sockets
Aug 07 18:47:11 dist-test-slave-07c2 krb5kdc[28590](info): commencing operation
krb5kdc: starting...
W20260807 18:47:12.598754 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:12 dist-test-slave-07c2 krb5kdc[28590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:12.718541 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42881
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:42881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:12.828567 28603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:12.828881 28603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:12.828964 28603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:12.832958 28603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:12.833037 28603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:12.833076 28603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:12.833134 28603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:12.833173 28603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:12.838289 28603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:42881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:42881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:12.839262 28603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:12.840273 28603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 18:47:12.848991 28603 server_base.cc:1034] running on GCE node
W20260807 18:47:12.848953 28608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:12.848995 28609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:12.848935 28611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:12.849773 28603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:12.850804 28603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:12.851959 28603 hybrid_clock.cc:648] HybridClock initialized: now 1786128432851934 us; error 39 us; skew 500 ppm
Aug 07 18:47:12 dist-test-slave-07c2 krb5kdc[28590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128432, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:12.854708 28603 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:12.855679 28603 webserver.cc:460] Webserver started at http://127.10.174.254:42255/ using document root <none> and password file <none>
I20260807 18:47:12.856153 28603 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:12.856207 28603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:12.856390 28603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:12.858304 28603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "99927b43de0b4417b6aaf8776fcde6a6"
format_stamp: "Formatted at 2026-08-07 18:47:12 on dist-test-slave-07c2"
server_key: "4c49a7e18f6fe2d70f6b2f0b5a752ac0"
server_key_iv: "fb6cadb09d9925c68b8e7a47f7f2fbdb"
server_key_version: "encryptionkey@0"
I20260807 18:47:12.858810 28603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "99927b43de0b4417b6aaf8776fcde6a6"
format_stamp: "Formatted at 2026-08-07 18:47:12 on dist-test-slave-07c2"
server_key: "4c49a7e18f6fe2d70f6b2f0b5a752ac0"
server_key_iv: "fb6cadb09d9925c68b8e7a47f7f2fbdb"
server_key_version: "encryptionkey@0"
I20260807 18:47:12.862322 28603 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:47:12.864629 28619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:12.865787 28603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:12.865911 28603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "99927b43de0b4417b6aaf8776fcde6a6"
format_stamp: "Formatted at 2026-08-07 18:47:12 on dist-test-slave-07c2"
server_key: "4c49a7e18f6fe2d70f6b2f0b5a752ac0"
server_key_iv: "fb6cadb09d9925c68b8e7a47f7f2fbdb"
server_key_version: "encryptionkey@0"
I20260807 18:47:12.866015 28603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:12.889637 28603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:12.893080 28603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:12.893307 28603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:12.899987 28603 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:42881
I20260807 18:47:12.900023 28671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:42881 every 8 connection(s)
I20260807 18:47:12.900887 28603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:12.903504 28672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:12.905164 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28603
I20260807 18:47:12.905407 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:12.905723 10939 external_mini_cluster.cc:1428] Setting key 66638dcba545c8fd25410521705f00ea
I20260807 18:47:12.910279 28672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6: Bootstrap starting.
I20260807 18:47:12.912792 28672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:12.913547 28672 log.cc:824] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:47:12 dist-test-slave-07c2 krb5kdc[28590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:12.915552 28672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6: No bootstrap required, opened a new log
I20260807 18:47:12.920154 28672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99927b43de0b4417b6aaf8776fcde6a6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42881 } }
I20260807 18:47:12.920400 28672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:12.920457 28672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99927b43de0b4417b6aaf8776fcde6a6, State: Initialized, Role: FOLLOWER
I20260807 18:47:12.920576 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:12.907153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40114 (local address 127.10.174.254:42881)
0807 18:47:12.907583 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:12.907603 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:12.907644 (+ 41us) server_negotiation.cc:407] Connection header received
0807 18:47:12.908405 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:12.908429 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:12.908846 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:12.909206 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:12.909875 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:12.911310 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:12.912158 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:12.912833 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:12.913005 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:12.915688 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:12.915694 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:12.915708 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:12.915736 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:12.917651 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:12.918075 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:12.918081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:12.918087 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:12.918224 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:12.918492 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:12.918495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:12.918497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:12.918955 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:12.919157 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:12.919376 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 18:47:12.919662 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":149,"threads_started":1}
I20260807 18:47:12.920957 28672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99927b43de0b4417b6aaf8776fcde6a6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42881 } }
I20260807 18:47:12.921113 28672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:12.921176 28672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:12.921265 28672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:12.922097 28672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99927b43de0b4417b6aaf8776fcde6a6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42881 } }
I20260807 18:47:12.922446 28672 leader_election.cc:302] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99927b43de0b4417b6aaf8776fcde6a6; no voters:
I20260807 18:47:12.922803 28672 leader_election.cc:288] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:12.922864 28677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:12.923063 28677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 99927b43de0b4417b6aaf8776fcde6a6, State: Running, Role: LEADER
I20260807 18:47:12.923378 28677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99927b43de0b4417b6aaf8776fcde6a6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42881 } }
I20260807 18:47:12.924016 28672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:12.925195 28678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99927b43de0b4417b6aaf8776fcde6a6. Latest consensus state: current_term: 1 leader_uuid: "99927b43de0b4417b6aaf8776fcde6a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99927b43de0b4417b6aaf8776fcde6a6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42881 } } }
I20260807 18:47:12.925223 28679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99927b43de0b4417b6aaf8776fcde6a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99927b43de0b4417b6aaf8776fcde6a6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 42881 } } }
I20260807 18:47:12.925330 28678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:12.925349 28679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:12.925729 28687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:12.928470 28687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:12.932989 28687 catalog_manager.cc:1347] Generated new cluster ID: e3134cf74152457291adc49f4ed10282
I20260807 18:47:12.933055 28687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:12.980067 28687 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:12.981015 28687 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:12.988724 28687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6: Generated new TSK 0
I20260807 18:47:12.989398 28687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:47:13.022017 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42881
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:13.132150 28700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:13.132392 28700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:13.132434 28700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:13.136368 28700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:13.136418 28700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:13.136523 28700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:47:13.141638 28700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:13.142642 28700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:13.143640 28700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:13.152806 28708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:13.152820 28705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:13.152830 28706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:13.153147 28700 server_base.cc:1034] running on GCE node
I20260807 18:47:13.153594 28700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:13.154210 28700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:13.155378 28700 hybrid_clock.cc:648] HybridClock initialized: now 1786128433155359 us; error 35 us; skew 500 ppm
Aug 07 18:47:13 dist-test-slave-07c2 krb5kdc[28590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:13.158285 28700 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:47:13.159175 28700 webserver.cc:460] Webserver started at http://127.10.174.193:38987/ using document root <none> and password file <none>
I20260807 18:47:13.159741 28700 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:13.159803 28700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:13.159965 28700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:13.161896 28700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "7b42ba2ea7aa484bbdecfef19727ac54"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "b7f8e5a14c01c96c5ef7d48e6c06a780"
server_key_iv: "282ad04cc0c8f8d96d5d6240243ef0a5"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.162410 28700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "7b42ba2ea7aa484bbdecfef19727ac54"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "b7f8e5a14c01c96c5ef7d48e6c06a780"
server_key_iv: "282ad04cc0c8f8d96d5d6240243ef0a5"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.165920 28700 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 18:47:13.168160 28716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.169432 28700 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:13.169554 28700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "7b42ba2ea7aa484bbdecfef19727ac54"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "b7f8e5a14c01c96c5ef7d48e6c06a780"
server_key_iv: "282ad04cc0c8f8d96d5d6240243ef0a5"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.169653 28700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:13.189467 28700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:13.192795 28700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:13.193009 28700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:13.193630 28700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:13.194474 28700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:13.194522 28700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.194598 28700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:13.194628 28700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.203605 28700 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:40715
I20260807 18:47:13.203632 28835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:40715 every 8 connection(s)
I20260807 18:47:13.204505 28700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:47:13.208292 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28700
I20260807 18:47:13.208438 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:47:13.208781 10939 external_mini_cluster.cc:1428] Setting key 9dd2cf8b662be34674ddfea4462c8daa
Aug 07 18:47:13 dist-test-slave-07c2 krb5kdc[28590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:47:13.220220 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.206428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:36595 (local address 127.10.174.254:42881)
0807 18:47:13.206570 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.206573 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.207477 (+ 904us) server_negotiation.cc:407] Connection header received
0807 18:47:13.209282 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.209286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.209357 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.209467 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:13.210748 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.211421 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.212865 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.213092 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.213182 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.216263 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:13.216267 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:13.216269 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:13.216296 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:13.217982 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.218531 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.218536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.218538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.218623 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.218981 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.218986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.218987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.219178 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:13.219322 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.219887 (+ 565us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.220039 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:47:13.221136 28838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.206813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42881 (local address 127.10.174.193:36595)
0807 18:47:13.207247 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:13.207357 (+ 110us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:13.208951 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:13.209668 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:13.209675 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:13.210063 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:13.210599 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.210612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.211550 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.211553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.212714 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.212730 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.213267 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.213281 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.213507 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.214170 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:13.214195 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:13.216066 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:13.218124 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:13.218131 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:13.218147 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:13.218422 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:13.218720 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:13.218724 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:13.218726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:13.218882 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:13.219323 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:13.219331 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:13.219639 (+ 308us) client_negotiation.cc:769] Sending connection context
0807 18:47:13.219844 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 18:47:13.220180 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:47:13.222465 28836 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42881
I20260807 18:47:13.222720 28836 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:13.223217 28836 heartbeater.cc:511] Master 127.10.174.254:42881 requested a full tablet report, sending...
I20260807 18:47:13.225025 28636 ts_manager.cc:194] Registered new tserver with Master: 7b42ba2ea7aa484bbdecfef19727ac54 (127.10.174.193:40715)
I20260807 18:47:13.226284 28636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:36595
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:47:13.237804 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42881
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:13.350979 28842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:13.351244 28842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:13.351357 28842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:13.355576 28842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:13.355635 28842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:13.355696 28842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:47:13.361042 28842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:13.362007 28842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:13.362941 28842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:13.372349 28848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:13.372357 28847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:13.372357 28850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:13.372738 28842 server_base.cc:1034] running on GCE node
I20260807 18:47:13.373180 28842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:13.373814 28842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:13.375000 28842 hybrid_clock.cc:648] HybridClock initialized: now 1786128433374986 us; error 24 us; skew 500 ppm
Aug 07 18:47:13 dist-test-slave-07c2 krb5kdc[28590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:13.377749 28842 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:47:13.378615 28842 webserver.cc:460] Webserver started at http://127.10.174.194:39433/ using document root <none> and password file <none>
I20260807 18:47:13.379159 28842 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:13.379253 28842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:13.379510 28842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:13.381438 28842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "62192fe156524dd5a5467dfc5c0e62f1"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "8fb3583cd2f5729b349caf4bf0400917"
server_key_iv: "67e5a3bcf31b74597078988f74101e9b"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.382004 28842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "62192fe156524dd5a5467dfc5c0e62f1"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "8fb3583cd2f5729b349caf4bf0400917"
server_key_iv: "67e5a3bcf31b74597078988f74101e9b"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.385504 28842 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 18:47:13.387737 28857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.388836 28842 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260807 18:47:13.388974 28842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "62192fe156524dd5a5467dfc5c0e62f1"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "8fb3583cd2f5729b349caf4bf0400917"
server_key_iv: "67e5a3bcf31b74597078988f74101e9b"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.389082 28842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:13.408456 28842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:13.411733 28842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:13.411940 28842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:13.412680 28842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:13.413656 28842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:13.413726 28842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.413798 28842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:13.413846 28842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.422765 28842 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:38059
I20260807 18:47:13.422802 28974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:38059 every 8 connection(s)
I20260807 18:47:13.423660 28842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:47:13.424893 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28842
I20260807 18:47:13.425026 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:47:13.425384 10939 external_mini_cluster.cc:1428] Setting key a5997216f8df58b11eb68561da6a233d
Aug 07 18:47:13 dist-test-slave-07c2 krb5kdc[28590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:47:13.437584 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.425542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:49255 (local address 127.10.174.254:42881)
0807 18:47:13.425681 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.425686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.426659 (+ 973us) server_negotiation.cc:407] Connection header received
0807 18:47:13.428078 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.428081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.428133 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.428210 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:13.429676 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.430188 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.431329 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.431577 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.431688 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.434047 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:13.434051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:13.434054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:13.434086 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:13.435578 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.436077 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.436081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.436083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.436164 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.436499 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.436504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.436506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.436685 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:13.436796 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.437285 (+ 489us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.437414 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
I20260807 18:47:13.438364 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.426033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42881 (local address 127.10.174.194:49255)
0807 18:47:13.426531 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:13.426580 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:13.427883 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:13.428367 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:13.428373 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:13.428871 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:13.429518 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.429537 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.430306 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.430309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.431183 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.431192 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.431732 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.431736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.431900 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.432491 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:13.432505 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:13.433891 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:13.435693 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:13.435699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:13.435712 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:13.435965 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:13.436255 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:13.436260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:13.436265 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:13.436402 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:13.436798 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:13.436806 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:13.437043 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 18:47:13.437219 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 18:47:13.437532 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":146,"threads_started":1}
I20260807 18:47:13.439637 28975 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42881
I20260807 18:47:13.439874 28975 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:13.440474 28975 heartbeater.cc:511] Master 127.10.174.254:42881 requested a full tablet report, sending...
I20260807 18:47:13.441663 28636 ts_manager.cc:194] Registered new tserver with Master: 62192fe156524dd5a5467dfc5c0e62f1 (127.10.174.194:38059)
I20260807 18:47:13.442531 28636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:49255
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:47:13.454478 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42881
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:13.564898 28980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:13.565207 28980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:13.565291 28980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:13.569418 28980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:13.569497 28980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:13.569583 28980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:47:13.576573 28980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:42881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:13.578002 28980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:13.579327 28980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:13.589952 28989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:13.589957 28985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:13.589957 28987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:13.590197 28980 server_base.cc:1034] running on GCE node
I20260807 18:47:13.590651 28980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:13.591279 28980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:13.592522 28980 hybrid_clock.cc:648] HybridClock initialized: now 1786128433592514 us; error 29 us; skew 500 ppm
Aug 07 18:47:13 dist-test-slave-07c2 krb5kdc[28590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:13.595325 28980 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:47:13.596220 28980 webserver.cc:460] Webserver started at http://127.10.174.195:36019/ using document root <none> and password file <none>
I20260807 18:47:13.596783 28980 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:13.596881 28980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:13.597112 28980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:13.599130 28980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "0b6e31afd5d14a9c81d7835226e446ce"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "0ca206e5efe9c590f33ec59c4d1116ce"
server_key_iv: "810be2601ba83fcd0baf891c669756ab"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.599784 28980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "0b6e31afd5d14a9c81d7835226e446ce"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "0ca206e5efe9c590f33ec59c4d1116ce"
server_key_iv: "810be2601ba83fcd0baf891c669756ab"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.603544 28980 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:47:13.605860 28996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.607229 28980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:13.607429 28980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "0b6e31afd5d14a9c81d7835226e446ce"
format_stamp: "Formatted at 2026-08-07 18:47:13 on dist-test-slave-07c2"
server_key: "0ca206e5efe9c590f33ec59c4d1116ce"
server_key_iv: "810be2601ba83fcd0baf891c669756ab"
server_key_version: "encryptionkey@0"
I20260807 18:47:13.607564 28980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:13.640986 28980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:13.644471 28980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:13.644678 28980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:13.645289 28980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:13.646232 28980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:13.646281 28980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.646350 28980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:13.646384 28980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:13.654930 28980 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:41371
I20260807 18:47:13.654980 29112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:41371 every 8 connection(s)
I20260807 18:47:13.655870 28980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:47:13.661227 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 28980
I20260807 18:47:13.661381 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:47:13.661682 10939 external_mini_cluster.cc:1428] Setting key 26882ccfc5c3efbad914efb6673b3ce4
Aug 07 18:47:13 dist-test-slave-07c2 krb5kdc[28590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:13.669409 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.657768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:33903 (local address 127.10.174.254:42881)
0807 18:47:13.657917 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.657920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.658724 (+ 804us) server_negotiation.cc:407] Connection header received
0807 18:47:13.660101 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.660105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.660165 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.660268 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:13.661445 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.662035 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.663360 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.663610 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.663720 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.666057 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:13.666060 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:13.666062 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:13.666086 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:13.667571 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.668032 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.668035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.668036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.668113 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.668405 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.668408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.668409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.668592 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:13.668669 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.669152 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.669289 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:47:13.670269 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.658126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:42881 (local address 127.10.174.195:33903)
0807 18:47:13.658569 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:13.658612 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:13.659891 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:13.660463 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:13.660470 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:13.660802 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:13.661265 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.661304 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.662160 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.662164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.663206 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.663217 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.663786 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.663791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.663957 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.664481 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:13.664496 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:13.665903 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:13.667686 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:13.667690 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:13.667700 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:13.667943 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:13.668198 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:13.668200 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:13.668201 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:13.668327 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:13.668681 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:13.668686 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:13.668958 (+ 272us) client_negotiation.cc:769] Sending connection context
0807 18:47:13.669110 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 18:47:13.669376 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":120,"threads_started":1}
I20260807 18:47:13.671391 29114 heartbeater.cc:347] Connected to a master server at 127.10.174.254:42881
I20260807 18:47:13.671630 29114 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:13.672101 29114 heartbeater.cc:511] Master 127.10.174.254:42881 requested a full tablet report, sending...
I20260807 18:47:13.673154 28636 ts_manager.cc:194] Registered new tserver with Master: 0b6e31afd5d14a9c81d7835226e446ce (127.10.174.195:41371)
I20260807 18:47:13.673781 28636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:33903
I20260807 18:47:13.675549 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:47:13.684563 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.677453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40122 (local address 127.10.174.254:42881)
0807 18:47:13.677576 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.677581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.677776 (+ 195us) server_negotiation.cc:407] Connection header received
0807 18:47:13.677929 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.677932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.677976 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.678059 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:13.678737 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.679225 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.680060 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.680294 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.680403 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.681730 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:13.681734 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:13.681736 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:13.681768 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:13.682892 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.683343 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.683347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.683349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.683431 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:13.683707 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:13.683710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:13.683712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:13.683924 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:13.684066 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.684297 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.684406 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:47:13.687096 28636 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:47:13.690026 28636 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:47:13.704260 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.698187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:41371 (local address 127.0.0.1:55258)
0807 18:47:13.698973 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:13.699023 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:13.699156 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:13.700183 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:13.700186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:13.700203 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:13.700309 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.700315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.701383 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.701387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.702664 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.702675 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.703693 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.703696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.703809 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.703845 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 18:47:13.703978 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 18:47:13.704093 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260807 18:47:13.704458 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.698960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.10.174.194:38059)
0807 18:47:13.699704 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.699716 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.699739 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:47:13.699828 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.699833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.700015 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.700204 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:13.700661 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.701745 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.703058 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.703875 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.704024 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.704138 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.704214 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.704296 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":126,"threads_started":1}
I20260807 18:47:13.704699 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.698440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:40715 (local address 127.0.0.1:45448)
0807 18:47:13.699427 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:13.699442 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:13.699528 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:13.699994 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:13.700000 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:13.700021 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:13.700167 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.700174 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.701616 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.701619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.702886 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.702893 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.704315 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.704319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.704425 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.704449 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:47:13.704514 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 18:47:13.704569 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"mutex_wait_us":84,"thread_start_us":97,"threads_started":1}
I20260807 18:47:13.704833 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.698975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45448 (local address 127.10.174.193:40715)
0807 18:47:13.699464 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.699479 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.699509 (+ 30us) server_negotiation.cc:407] Connection header received
0807 18:47:13.699678 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.699683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.699844 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.700004 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:13.700310 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.701467 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.703007 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.703875 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.704024 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.704138 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.704573 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.704684 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":102,"threads_started":1}
I20260807 18:47:13.705111 29127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.698331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55258 (local address 127.10.174.195:41371)
0807 18:47:13.699724 (+ 1393us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:13.699737 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:13.699756 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:47:13.699827 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:13.699832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:13.700015 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:13.700204 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:13.700426 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.701230 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.702795 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.703568 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.703706 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.703843 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:13.704878 (+ 1035us) server_negotiation.cc:299] Negotiation successful
0807 18:47:13.704976 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1301,"thread_start_us":191,"threads_started":1}
I20260807 18:47:13.704456 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:13.698410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:38059 (local address 127.0.0.1:51714)
0807 18:47:13.699384 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:13.699398 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:13.699482 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:13.700396 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:13.700399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:13.700420 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:13.700526 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.700533 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.701893 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.701897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.702956 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:13.702966 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:13.704007 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:13.704010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:13.704088 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:13.704108 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 18:47:13.704164 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 18:47:13.704219 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":913,"mutex_wait_us":1,"thread_start_us":88,"threads_started":1}
I20260807 18:47:13.707885 29045 tablet_service.cc:1467] Processing CreateTablet for tablet cc15f807d2274d298214a51fc03d6756 (DEFAULT_TABLE table=test-table [id=59c4425a0ebb4bf49136da2245a154e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:13.707919 28765 tablet_service.cc:1467] Processing CreateTablet for tablet cc15f807d2274d298214a51fc03d6756 (DEFAULT_TABLE table=test-table [id=59c4425a0ebb4bf49136da2245a154e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:13.708249 28906 tablet_service.cc:1467] Processing CreateTablet for tablet cc15f807d2274d298214a51fc03d6756 (DEFAULT_TABLE table=test-table [id=59c4425a0ebb4bf49136da2245a154e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:13.708967 28765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc15f807d2274d298214a51fc03d6756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:13.708971 29045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc15f807d2274d298214a51fc03d6756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:13.709123 28906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc15f807d2274d298214a51fc03d6756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:13.715422 29132 tablet_bootstrap.cc:492] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Bootstrap starting.
I20260807 18:47:13.716710 29133 tablet_bootstrap.cc:492] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: Bootstrap starting.
I20260807 18:47:13.716710 29134 tablet_bootstrap.cc:492] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Bootstrap starting.
I20260807 18:47:13.717592 29132 tablet_bootstrap.cc:654] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:13.718643 29132 log.cc:824] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:13.718830 29134 tablet_bootstrap.cc:654] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:13.718830 29133 tablet_bootstrap.cc:654] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:13.720189 29134 log.cc:824] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:13.720189 29133 log.cc:824] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:13.721093 29132 tablet_bootstrap.cc:492] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: No bootstrap required, opened a new log
I20260807 18:47:13.721319 29132 ts_tablet_manager.cc:1397] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:47:13.722093 29133 tablet_bootstrap.cc:492] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: No bootstrap required, opened a new log
I20260807 18:47:13.722289 29133 ts_tablet_manager.cc:1397] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:47:13.722434 29134 tablet_bootstrap.cc:492] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: No bootstrap required, opened a new log
I20260807 18:47:13.722599 29134 ts_tablet_manager.cc:1397] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:47:13.724814 29132 raft_consensus.cc:348] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:13.725067 29132 raft_consensus.cc:374] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:13.725188 29132 raft_consensus.cc:729] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b6e31afd5d14a9c81d7835226e446ce, State: Initialized, Role: FOLLOWER
I20260807 18:47:13.725673 29132 consensus_queue.cc:260] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:13.726087 29133 raft_consensus.cc:348] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:13.726426 29133 raft_consensus.cc:374] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:13.726523 29133 raft_consensus.cc:729] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b42ba2ea7aa484bbdecfef19727ac54, State: Initialized, Role: FOLLOWER
I20260807 18:47:13.726466 29134 raft_consensus.cc:348] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:13.726703 29134 raft_consensus.cc:374] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:13.726815 29134 raft_consensus.cc:729] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62192fe156524dd5a5467dfc5c0e62f1, State: Initialized, Role: FOLLOWER
I20260807 18:47:13.726996 29133 consensus_queue.cc:260] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:13.727098 29132 ts_tablet_manager.cc:1428] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:47:13.727205 29134 consensus_queue.cc:260] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:13.727516 29114 heartbeater.cc:503] Master 127.10.174.254:42881 was elected leader, sending a full tablet report...
I20260807 18:47:13.727619 28836 heartbeater.cc:503] Master 127.10.174.254:42881 was elected leader, sending a full tablet report...
I20260807 18:47:13.727880 29133 ts_tablet_manager.cc:1428] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:47:13.729070 29134 ts_tablet_manager.cc:1428] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:47:13.729403 28975 heartbeater.cc:503] Master 127.10.174.254:42881 was elected leader, sending a full tablet report...
W20260807 18:47:13.906885 29115 tablet.cc:2369] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:47:13.924857 28976 tablet.cc:2369] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:47:13.955928 28837 tablet.cc:2369] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:14.087242 29140 raft_consensus.cc:482] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:14.087381 29141 raft_consensus.cc:482] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:14.087551 29140 raft_consensus.cc:504] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:14.087595 29141 raft_consensus.cc:504] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:14.088747 29140 leader_election.cc:288] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b6e31afd5d14a9c81d7835226e446ce (127.10.174.195:41371), 62192fe156524dd5a5467dfc5c0e62f1 (127.10.174.194:38059)
I20260807 18:47:14.089558 29141 leader_election.cc:288] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b6e31afd5d14a9c81d7835226e446ce (127.10.174.195:41371), 7b42ba2ea7aa484bbdecfef19727ac54 (127.10.174.193:40715)
I20260807 18:47:14.094323 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.089271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:54881 (local address 127.10.174.193:40715)
0807 18:47:14.089522 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.089527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.089723 (+ 196us) server_negotiation.cc:407] Connection header received
0807 18:47:14.090065 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.090069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.090114 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.090184 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:14.090836 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.091560 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093136 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.093690 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093773 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.093849 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.094131 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.094194 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":179}
I20260807 18:47:14.094323 29127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.089176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:45083 (local address 127.10.174.195:41371)
0807 18:47:14.089425 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.089430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.089909 (+ 479us) server_negotiation.cc:407] Connection header received
0807 18:47:14.090024 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.090029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.090082 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.090168 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:14.090557 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.091331 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.092922 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.093522 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093608 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.093660 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.094124 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.094196 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146}
I20260807 18:47:14.094367 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.089692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:46615 (local address 127.10.174.194:38059)
0807 18:47:14.089819 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.089825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.090206 (+ 381us) server_negotiation.cc:407] Connection header received
0807 18:47:14.090380 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.090382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.090428 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.090477 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:14.090858 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.091413 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093037 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.093617 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093700 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.093743 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.094168 (+ 425us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.094237 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:47:14.094754 29143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.088962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:41371 (local address 127.10.174.193:45083)
0807 18:47:14.089800 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.089814 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:14.089926 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:14.090203 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:14.090207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:14.090254 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:14.090463 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.090473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.091453 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.091457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.092778 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.092789 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.093789 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.093958 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.094000 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 18:47:14.094454 (+ 454us) client_negotiation.cc:240] Negotiation successful
0807 18:47:14.094543 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":109,"spinlock_wait_cycles":31872,"thread_start_us":88,"threads_started":1}
I20260807 18:47:14.094810 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.089000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:38059 (local address 127.10.174.193:46615)
0807 18:47:14.090114 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.090125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:14.090261 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:14.090612 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:14.090615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:14.090632 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:14.090723 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.090729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.091570 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.091575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.092895 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.092906 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.093866 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093871 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.094025 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.094049 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:47:14.094543 (+ 494us) client_negotiation.cc:240] Negotiation successful
0807 18:47:14.094622 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1053,"mutex_wait_us":38,"spinlock_wait_cycles":2304,"thread_start_us":131,"threads_started":1}
I20260807 18:47:14.095124 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.088963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:40715 (local address 127.10.174.194:54881)
0807 18:47:14.089565 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.089630 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:14.089904 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:14.090587 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:14.090591 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:14.090608 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:14.090716 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.090723 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.091675 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.091679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.093012 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.093021 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.093897 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.093999 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.094020 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 18:47:14.094874 (+ 854us) client_negotiation.cc:240] Negotiation successful
0807 18:47:14.094954 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":30,"thread_start_us":75,"threads_started":1}
I20260807 18:47:14.095436 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.089391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:43929 (local address 127.10.174.195:41371)
0807 18:47:14.089920 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.089929 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.089942 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:47:14.090390 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.090394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.090435 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.090527 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:14.091651 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.092458 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.093922 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.094633 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.094742 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.094795 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.095186 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.095270 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":439,"thread_start_us":95,"threads_started":1}
I20260807 18:47:14.095487 29065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6e31afd5d14a9c81d7835226e446ce" is_pre_election: true
I20260807 18:47:14.095487 28927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62192fe156524dd5a5467dfc5c0e62f1" is_pre_election: true
I20260807 18:47:14.095655 29145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.089346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:41371 (local address 127.10.174.194:43929)
0807 18:47:14.089825 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.089840 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:14.090292 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:14.091382 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:14.091385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:14.091405 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:14.091520 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.091528 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.092588 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.092591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.093792 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.093804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.094865 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.094869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.094954 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.094973 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 18:47:14.095045 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 18:47:14.095093 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260807 18:47:14.095709 28927 raft_consensus.cc:2454] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b42ba2ea7aa484bbdecfef19727ac54 in term 0.
I20260807 18:47:14.095755 29065 raft_consensus.cc:2454] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b42ba2ea7aa484bbdecfef19727ac54 in term 0.
I20260807 18:47:14.096155 28786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "62192fe156524dd5a5467dfc5c0e62f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" is_pre_election: true
I20260807 18:47:14.096199 28720 leader_election.cc:302] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b6e31afd5d14a9c81d7835226e446ce, 62192fe156524dd5a5467dfc5c0e62f1, 7b42ba2ea7aa484bbdecfef19727ac54; no voters:
I20260807 18:47:14.096343 28786 raft_consensus.cc:2454] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62192fe156524dd5a5467dfc5c0e62f1 in term 0.
I20260807 18:47:14.096596 29140 raft_consensus.cc:2781] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:14.096683 29140 raft_consensus.cc:482] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:14.096736 29140 raft_consensus.cc:3037] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:14.096717 29065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "62192fe156524dd5a5467dfc5c0e62f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6e31afd5d14a9c81d7835226e446ce" is_pre_election: true
I20260807 18:47:14.096837 29065 raft_consensus.cc:2454] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62192fe156524dd5a5467dfc5c0e62f1 in term 0.
I20260807 18:47:14.096809 28858 leader_election.cc:302] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62192fe156524dd5a5467dfc5c0e62f1, 7b42ba2ea7aa484bbdecfef19727ac54; no voters:
I20260807 18:47:14.097083 29141 raft_consensus.cc:2781] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:14.097173 29141 raft_consensus.cc:482] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:14.097227 29141 raft_consensus.cc:3037] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:14.097934 29140 raft_consensus.cc:504] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:14.098266 29141 raft_consensus.cc:504] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:14.098333 29140 leader_election.cc:288] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [CANDIDATE]: Term 1 election: Requested vote from peers 0b6e31afd5d14a9c81d7835226e446ce (127.10.174.195:41371), 62192fe156524dd5a5467dfc5c0e62f1 (127.10.174.194:38059)
I20260807 18:47:14.098627 29141 leader_election.cc:288] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0b6e31afd5d14a9c81d7835226e446ce (127.10.174.195:41371), 7b42ba2ea7aa484bbdecfef19727ac54 (127.10.174.193:40715)
I20260807 18:47:14.098620 29065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6e31afd5d14a9c81d7835226e446ce"
I20260807 18:47:14.098703 28927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62192fe156524dd5a5467dfc5c0e62f1"
I20260807 18:47:14.098729 29065 raft_consensus.cc:3037] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:14.098861 28927 raft_consensus.cc:2379] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b42ba2ea7aa484bbdecfef19727ac54 in current term 1: Already voted for candidate 62192fe156524dd5a5467dfc5c0e62f1 in this term.
I20260807 18:47:14.098966 29064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "62192fe156524dd5a5467dfc5c0e62f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b6e31afd5d14a9c81d7835226e446ce"
I20260807 18:47:14.099007 28786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc15f807d2274d298214a51fc03d6756" candidate_uuid: "62192fe156524dd5a5467dfc5c0e62f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b42ba2ea7aa484bbdecfef19727ac54"
I20260807 18:47:14.099143 28786 raft_consensus.cc:2379] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62192fe156524dd5a5467dfc5c0e62f1 in current term 1: Already voted for candidate 7b42ba2ea7aa484bbdecfef19727ac54 in this term.
I20260807 18:47:14.099650 28858 leader_election.cc:302] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62192fe156524dd5a5467dfc5c0e62f1; no voters: 0b6e31afd5d14a9c81d7835226e446ce, 7b42ba2ea7aa484bbdecfef19727ac54
I20260807 18:47:14.099831 29141 raft_consensus.cc:2726] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 18:47:14.100117 29065 raft_consensus.cc:2454] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b42ba2ea7aa484bbdecfef19727ac54 in term 1.
I20260807 18:47:14.100383 28720 leader_election.cc:302] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b6e31afd5d14a9c81d7835226e446ce, 7b42ba2ea7aa484bbdecfef19727ac54; no voters: 62192fe156524dd5a5467dfc5c0e62f1
I20260807 18:47:14.100557 29140 raft_consensus.cc:2781] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:14.100800 29140 raft_consensus.cc:686] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 1 LEADER]: Becoming Leader. State: Replica: 7b42ba2ea7aa484bbdecfef19727ac54, State: Running, Role: LEADER
I20260807 18:47:14.101117 29140 consensus_queue.cc:237] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } }
I20260807 18:47:14.104238 28634 catalog_manager.cc:5495] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b42ba2ea7aa484bbdecfef19727ac54 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b42ba2ea7aa484bbdecfef19727ac54" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 40715 } health_report { overall_health: HEALTHY } } }
I20260807 18:47:14.154279 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.150972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45454 (local address 127.10.174.193:40715)
0807 18:47:14.151107 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.151110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.151125 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:47:14.151234 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.151236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.151322 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.151402 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:14.151647 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.152141 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.152960 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.153169 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.153247 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.153498 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:14.153912 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:14.154002 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.154125 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.154170 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:47:14.160079 29065 raft_consensus.cc:1261] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 1 FOLLOWER]: Refusing update from remote peer 7b42ba2ea7aa484bbdecfef19727ac54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:14.160084 28927 raft_consensus.cc:1261] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 1 FOLLOWER]: Refusing update from remote peer 7b42ba2ea7aa484bbdecfef19727ac54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:14.160755 29147 consensus_queue.cc:1035] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b6e31afd5d14a9c81d7835226e446ce" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 41371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:14.160985 29140 consensus_queue.cc:1035] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62192fe156524dd5a5467dfc5c0e62f1" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 38059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:14.177232 28635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:14.177423 28635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:14.179812 28635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 99927b43de0b4417b6aaf8776fcde6a6: Sending DeleteTablet for 3 replicas of tablet cc15f807d2274d298214a51fc03d6756
I20260807 18:47:14.180588 28906 tablet_service.cc:1514] Processing DeleteTablet for tablet cc15f807d2274d298214a51fc03d6756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:14 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:51714
I20260807 18:47:14.180601 29045 tablet_service.cc:1514] Processing DeleteTablet for tablet cc15f807d2274d298214a51fc03d6756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:14 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:55258
I20260807 18:47:14.181083 29160 tablet_replica.cc:330] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: stopping tablet replica
I20260807 18:47:14.181072 28765 tablet_service.cc:1514] Processing DeleteTablet for tablet cc15f807d2274d298214a51fc03d6756 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:14 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:45448
I20260807 18:47:14.181463 29162 tablet_replica.cc:330] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54: stopping tablet replica
I20260807 18:47:14.181521 29160 raft_consensus.cc:2229] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:14.181815 29162 raft_consensus.cc:2229] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:47:14.181908 29160 raft_consensus.cc:2258] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:14.182219 29162 raft_consensus.cc:2258] T cc15f807d2274d298214a51fc03d6756 P 7b42ba2ea7aa484bbdecfef19727ac54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:14.182420 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28700
I20260807 18:47:14.183779 29160 ts_tablet_manager.cc:1905] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:14.185273 29161 tablet_replica.cc:330] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: stopping tablet replica
I20260807 18:47:14.185606 29161 raft_consensus.cc:2229] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:14.185952 29161 raft_consensus.cc:2258] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:14.186902 29160 ts_tablet_manager.cc:1918] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:14.187011 29160 log.cc:1196] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/cc15f807d2274d298214a51fc03d6756
I20260807 18:47:14.187418 29160 ts_tablet_manager.cc:1939] T cc15f807d2274d298214a51fc03d6756 P 0b6e31afd5d14a9c81d7835226e446ce: Deleting consensus metadata
I20260807 18:47:14.187563 29161 ts_tablet_manager.cc:1905] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:14.188787 28623 catalog_manager.cc:4841] TS 0b6e31afd5d14a9c81d7835226e446ce (127.10.174.195:41371): tablet cc15f807d2274d298214a51fc03d6756 (table test-table [id=59c4425a0ebb4bf49136da2245a154e4]) successfully deleted
W20260807 18:47:14.190265 28620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:40715 (error 108)
I20260807 18:47:14.190665 29161 ts_tablet_manager.cc:1918] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:14.190797 29161 log.cc:1196] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/cc15f807d2274d298214a51fc03d6756
I20260807 18:47:14.191131 29161 ts_tablet_manager.cc:1939] T cc15f807d2274d298214a51fc03d6756 P 62192fe156524dd5a5467dfc5c0e62f1: Deleting consensus metadata
I20260807 18:47:14.191382 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.191057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:40715 (local address 127.0.0.1:45468)
0807 18:47:14.191188 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.191269 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:40715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 18:47:14.191422 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28842
W20260807 18:47:14.194294 28620 catalog_manager.cc:4584] TS 7b42ba2ea7aa484bbdecfef19727ac54 (127.10.174.193:40715): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc15f807d2274d298214a51fc03d6756: Network error: Client connection negotiation failed: client connection to 127.10.174.193:40715: connect: Connection refused (error 111)
I20260807 18:47:14.198581 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28980
I20260807 18:47:14.199637 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.198741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:38059 (local address 127.0.0.1:51728)
0807 18:47:14.199468 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.199533 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.194:38059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":625}
I20260807 18:47:14.205444 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 28603
2026-08-07T18:47:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2684 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T18:47:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:14Z Disabled control of system clock
I20260807 18:47:14.238365 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38871
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:46355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:38871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 18:47:14.352803 29167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:14.353086 29167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:14.353149 29167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:14.357401 29167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:14.357474 29167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:14.357491 29167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:14.357530 29167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:14.357564 29167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:14.362563 29167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:38871
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:38871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:14.363868 29167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:14.365339 29167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:14.373870 29173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:14.373870 29175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:14.373871 29172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:14.374158 29167 server_base.cc:1034] running on GCE node
I20260807 18:47:14.374866 29167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:14.376026 29167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:14.377218 29167 hybrid_clock.cc:648] HybridClock initialized: now 1786128434377201 us; error 28 us; skew 500 ppm
I20260807 18:47:14.379016 29167 webserver.cc:460] Webserver started at http://127.10.174.254:38005/ using document root <none> and password file <none>
I20260807 18:47:14.379647 29167 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:14.379739 29167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:14.379979 29167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:14.381986 29167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "d8454155cbe148a18d5b9375dc40d916"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "b91d7d872e0860102e70f2c5b7bc4ef2"
server_key_iv: "4aab03b5368fdb9dbf31bae63c99534d"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.382555 29167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "d8454155cbe148a18d5b9375dc40d916"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "b91d7d872e0860102e70f2c5b7bc4ef2"
server_key_iv: "4aab03b5368fdb9dbf31bae63c99534d"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.386143 29167 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:47:14.388522 29181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.389724 29167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:14.389869 29167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "d8454155cbe148a18d5b9375dc40d916"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "b91d7d872e0860102e70f2c5b7bc4ef2"
server_key_iv: "4aab03b5368fdb9dbf31bae63c99534d"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.389978 29167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:14.401257 29167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:14.401953 29167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:14.402150 29167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:14.409087 29167 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:38871
I20260807 18:47:14.409102 29233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:38871 every 8 connection(s)
I20260807 18:47:14.410040 29167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:14.413146 29234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:14.414815 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29167
I20260807 18:47:14.414970 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:14.415283 10939 external_mini_cluster.cc:1428] Setting key 933757ad04224a3a045ad8ef9d9664d8
I20260807 18:47:14.419843 29234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916: Bootstrap starting.
I20260807 18:47:14.422065 29234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:14.422973 29234 log.cc:824] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:14.424705 29237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.416864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37172 (local address 127.10.174.254:38871)
0807 18:47:14.417509 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.417524 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.417561 (+ 37us) server_negotiation.cc:407] Connection header received
0807 18:47:14.418217 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.418234 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.418611 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.419004 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:14.419478 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.420488 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.421381 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.421852 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.422024 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.422906 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:14.422911 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:14.422923 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:14.423406 (+ 483us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:14.423463 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:14.423485 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:14.423598 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.423750 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.424004 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":134,"threads_started":1}
I20260807 18:47:14.425113 29234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916: No bootstrap required, opened a new log
I20260807 18:47:14.429162 29234 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8454155cbe148a18d5b9375dc40d916" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38871 } }
I20260807 18:47:14.429486 29234 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:14.429584 29234 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8454155cbe148a18d5b9375dc40d916, State: Initialized, Role: FOLLOWER
I20260807 18:47:14.430058 29234 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8454155cbe148a18d5b9375dc40d916" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38871 } }
I20260807 18:47:14.430208 29234 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:14.430302 29234 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:14.430408 29234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:14.431435 29234 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8454155cbe148a18d5b9375dc40d916" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38871 } }
I20260807 18:47:14.431777 29234 leader_election.cc:302] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8454155cbe148a18d5b9375dc40d916; no voters:
I20260807 18:47:14.432125 29234 leader_election.cc:288] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:14.432273 29239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:14.432518 29239 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [term 1 LEADER]: Becoming Leader. State: Replica: d8454155cbe148a18d5b9375dc40d916, State: Running, Role: LEADER
I20260807 18:47:14.432873 29239 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8454155cbe148a18d5b9375dc40d916" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38871 } }
I20260807 18:47:14.433499 29234 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:14.434388 29240 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8454155cbe148a18d5b9375dc40d916" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8454155cbe148a18d5b9375dc40d916" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38871 } } }
I20260807 18:47:14.434700 29241 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8454155cbe148a18d5b9375dc40d916. Latest consensus state: current_term: 1 leader_uuid: "d8454155cbe148a18d5b9375dc40d916" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8454155cbe148a18d5b9375dc40d916" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 38871 } } }
I20260807 18:47:14.434824 29240 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:14.434908 29241 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:14.435396 29248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:14.438695 29248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:14.444741 29248 catalog_manager.cc:1347] Generated new cluster ID: e0aa3c95d5aa48009fb238907285ff36
I20260807 18:47:14.444837 29248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:14.457273 29248 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:14.458400 29248 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:14.477016 29248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916: Generated new TSK 0
I20260807 18:47:14.477790 29248 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:14.487775 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38871
--builtin_ntp_servers=127.10.174.212:46355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 18:47:14.607059 29259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:14.607338 29259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:14.607380 29259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:14.611317 29259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:14.611366 29259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:14.611420 29259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:47:14.616222 29259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:14.617250 29259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:14.618563 29259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:14.628144 29264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:14.628225 29259 server_base.cc:1034] running on GCE node
W20260807 18:47:14.628146 29269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:14.628139 29265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:14.628933 29259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:14.629647 29259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:14.630836 29259 hybrid_clock.cc:648] HybridClock initialized: now 1786128434630805 us; error 43 us; skew 500 ppm
I20260807 18:47:14.632795 29259 webserver.cc:460] Webserver started at http://127.10.174.193:35063/ using document root <none> and password file <none>
I20260807 18:47:14.633368 29259 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:14.633462 29259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:14.633693 29259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:14.636070 29259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "f5bde237d94b4a6e83b197bbf0b35a05"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "aba66064278f198bac87d84e4cd44678"
server_key_iv: "06702e9d106ca4d1e6336a4748e2a202"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.636652 29259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "f5bde237d94b4a6e83b197bbf0b35a05"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "aba66064278f198bac87d84e4cd44678"
server_key_iv: "06702e9d106ca4d1e6336a4748e2a202"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.640251 29259 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:47:14.642617 29275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.643878 29259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:14.644008 29259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "f5bde237d94b4a6e83b197bbf0b35a05"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "aba66064278f198bac87d84e4cd44678"
server_key_iv: "06702e9d106ca4d1e6336a4748e2a202"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.644124 29259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:14.670169 29259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:14.670989 29259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:14.671204 29259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:14.671840 29259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:14.672811 29259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:14.672883 29259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.672960 29259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:14.673015 29259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.681713 29259 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:46021
I20260807 18:47:14.681782 29391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:46021 every 8 connection(s)
I20260807 18:47:14.682667 29259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:47:14.685997 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29259
I20260807 18:47:14.686151 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:47:14.686460 10939 external_mini_cluster.cc:1428] Setting key 818c4a4e0da533a186adf26466fe6c52
I20260807 18:47:14.688858 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38871
--builtin_ntp_servers=127.10.174.212:46355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 18:47:14.692426 29237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.684492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:43105 (local address 127.10.174.254:38871)
0807 18:47:14.684630 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.684634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.685630 (+ 996us) server_negotiation.cc:407] Connection header received
0807 18:47:14.687269 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.687308 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.687370 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.687480 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:14.688562 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.689182 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.690316 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.690563 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.690674 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.691906 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:14.691909 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:14.691912 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:14.691924 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:14.691949 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:14.691962 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:14.692040 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.692209 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.692285 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:47:14.693290 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.684899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38871 (local address 127.10.174.193:43105)
0807 18:47:14.685510 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.685549 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:14.686985 (+ 1436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:14.687662 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:14.687670 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:14.687769 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:14.688398 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.688414 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.689320 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.689323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.690177 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.690186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.690716 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.690721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.690887 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.691549 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:14.691550 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:14.691589 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:14.691651 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:14.692057 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:14.692067 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:14.692079 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 18:47:14.692203 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 18:47:14.692468 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":114,"threads_started":1}
I20260807 18:47:14.694555 29392 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38871
I20260807 18:47:14.694826 29392 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:14.695485 29392 heartbeater.cc:511] Master 127.10.174.254:38871 requested a full tablet report, sending...
I20260807 18:47:14.696959 29198 ts_manager.cc:194] Registered new tserver with Master: f5bde237d94b4a6e83b197bbf0b35a05 (127.10.174.193:46021)
I20260807 18:47:14.698369 29198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.193:43105
W20260807 18:47:14.801184 29395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:14.801498 29395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:14.801574 29395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:14.805583 29395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:14.805681 29395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:14.805778 29395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:47:14.810635 29395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:14.811836 29395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:14.813272 29395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:14.823217 29401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:14.823210 29400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:14.823210 29403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:14.823553 29395 server_base.cc:1034] running on GCE node
I20260807 18:47:14.824029 29395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:14.824707 29395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:14.825873 29395 hybrid_clock.cc:648] HybridClock initialized: now 1786128434825842 us; error 45 us; skew 500 ppm
I20260807 18:47:14.827898 29395 webserver.cc:460] Webserver started at http://127.10.174.194:37069/ using document root <none> and password file <none>
I20260807 18:47:14.828495 29395 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:14.828574 29395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:14.828837 29395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:14.830940 29395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "a795143378d686c98f0aa8ca98205355"
server_key_iv: "48e1929d6e54a258d1cf8b886acf534d"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.831542 29395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "a795143378d686c98f0aa8ca98205355"
server_key_iv: "48e1929d6e54a258d1cf8b886acf534d"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.835466 29395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:47:14.837873 29410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.839056 29395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:14.839192 29395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93"
format_stamp: "Formatted at 2026-08-07 18:47:14 on dist-test-slave-07c2"
server_key: "a795143378d686c98f0aa8ca98205355"
server_key_iv: "48e1929d6e54a258d1cf8b886acf534d"
server_key_version: "encryptionkey@0"
I20260807 18:47:14.839341 29395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:14.857537 29395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:14.858289 29395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:14.858510 29395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:14.859252 29395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:14.860266 29395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:14.860317 29395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.860357 29395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:14.860379 29395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:14.869309 29395 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:35911
I20260807 18:47:14.869338 29525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:35911 every 8 connection(s)
I20260807 18:47:14.870206 29395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:47:14.876545 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29395
I20260807 18:47:14.876654 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:47:14.876942 10939 external_mini_cluster.cc:1428] Setting key 8dbf3e1952fcace3a52082e0b20a797f
I20260807 18:47:14.879136 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38871
--builtin_ntp_servers=127.10.174.212:46355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 18:47:14.879391 29237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.872008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:36129 (local address 127.10.174.254:38871)
0807 18:47:14.872188 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:14.872192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:14.873210 (+ 1018us) server_negotiation.cc:407] Connection header received
0807 18:47:14.874510 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:14.874513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:14.874560 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:14.874637 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:14.875506 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.876038 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.877283 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.877541 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.877659 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.878813 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:14.878817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:14.878821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:14.878839 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:14.878864 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:14.878878 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:14.878963 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:14.879105 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 18:47:14.879180 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 18:47:14.880196 29528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:14.872425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38871 (local address 127.10.174.194:36129)
0807 18:47:14.873062 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:14.873103 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:14.874333 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:14.874809 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:14.874815 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:14.874894 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:14.875375 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.875387 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.876145 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.876147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.877162 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:14.877172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:14.877716 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:14.877720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:14.877889 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:14.878547 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:14.878549 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:14.878588 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:14.878650 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:14.878968 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:14.878975 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:14.878979 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:47:14.879069 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 18:47:14.879386 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":117,"threads_started":1}
I20260807 18:47:14.881471 29526 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38871
I20260807 18:47:14.881711 29526 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:14.882280 29526 heartbeater.cc:511] Master 127.10.174.254:38871 requested a full tablet report, sending...
I20260807 18:47:14.883441 29198 ts_manager.cc:194] Registered new tserver with Master: fbe6ba83cc1f4ffb8d227cb960ab6c93 (127.10.174.194:35911)
I20260807 18:47:14.884006 29198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.194:36129
W20260807 18:47:14.994225 29529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:14.994539 29529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:14.994618 29529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:14.998832 29529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:14.998926 29529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:14.999022 29529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:47:15.003873 29529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:46355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:38871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:15.005007 29529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:15.006505 29529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:15.016242 29534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:15.016261 29537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:15.016242 29535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:15.016458 29529 server_base.cc:1034] running on GCE node
I20260807 18:47:15.016985 29529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:15.017619 29529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:15.018823 29529 hybrid_clock.cc:648] HybridClock initialized: now 1786128435018811 us; error 30 us; skew 500 ppm
I20260807 18:47:15.020655 29529 webserver.cc:460] Webserver started at http://127.10.174.195:46143/ using document root <none> and password file <none>
I20260807 18:47:15.021238 29529 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:15.021332 29529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:15.021564 29529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:15.023631 29529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "cc62e05f20824d86b80585b90743af20"
format_stamp: "Formatted at 2026-08-07 18:47:15 on dist-test-slave-07c2"
server_key: "39f9cfc1e9ecb9b84118660cb7f00d7f"
server_key_iv: "e7b8c2ac3c6fbf4670d911cf72b84ac7"
server_key_version: "encryptionkey@0"
I20260807 18:47:15.024196 29529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "cc62e05f20824d86b80585b90743af20"
format_stamp: "Formatted at 2026-08-07 18:47:15 on dist-test-slave-07c2"
server_key: "39f9cfc1e9ecb9b84118660cb7f00d7f"
server_key_iv: "e7b8c2ac3c6fbf4670d911cf72b84ac7"
server_key_version: "encryptionkey@0"
I20260807 18:47:15.027818 29529 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:47:15.030222 29543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:15.031507 29529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:15.031635 29529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "cc62e05f20824d86b80585b90743af20"
format_stamp: "Formatted at 2026-08-07 18:47:15 on dist-test-slave-07c2"
server_key: "39f9cfc1e9ecb9b84118660cb7f00d7f"
server_key_iv: "e7b8c2ac3c6fbf4670d911cf72b84ac7"
server_key_version: "encryptionkey@0"
I20260807 18:47:15.031745 29529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:15.046947 29529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:15.047716 29529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:15.047922 29529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:15.048559 29529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:15.049510 29529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:15.049579 29529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:15.049651 29529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:15.049705 29529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:15.058137 29529 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:36853
I20260807 18:47:15.058164 29660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:36853 every 8 connection(s)
I20260807 18:47:15.058990 29529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:47:15.067132 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29529
I20260807 18:47:15.067252 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:47:15.067601 10939 external_mini_cluster.cc:1428] Setting key 13d3e5ebc3c693926b324c269dda2755
I20260807 18:47:15.068217 29237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.060810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:58037 (local address 127.10.174.254:38871)
0807 18:47:15.060959 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.060963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.061947 (+ 984us) server_negotiation.cc:407] Connection header received
0807 18:47:15.063364 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.063368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.063431 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.063535 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:15.064443 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.064979 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.066094 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.066326 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.066440 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.067680 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:15.067699 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:15.067705 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:15.067720 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:15.067745 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:15.067763 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:15.067846 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.068005 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.068072 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:47:15.069269 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.061191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:38871 (local address 127.10.174.195:58037)
0807 18:47:15.061806 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.061845 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:15.063121 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:15.063735 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:15.063741 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:15.063821 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:15.064297 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.064309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.065106 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.065110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.065970 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.065978 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.066478 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.066482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.066646 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.067399 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:15.067401 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:15.067460 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:15.067523 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:15.067848 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:15.067859 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:15.067867 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 18:47:15.068004 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 18:47:15.068285 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":113,"threads_started":1}
I20260807 18:47:15.070323 29661 heartbeater.cc:347] Connected to a master server at 127.10.174.254:38871
I20260807 18:47:15.070518 29661 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:15.070962 29661 heartbeater.cc:511] Master 127.10.174.254:38871 requested a full tablet report, sending...
I20260807 18:47:15.071938 29198 ts_manager.cc:194] Registered new tserver with Master: cc62e05f20824d86b80585b90743af20 (127.10.174.195:36853)
I20260807 18:47:15.072499 29198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.195:58037
I20260807 18:47:15.081532 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:47:15.087006 29237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.083568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37184 (local address 127.10.174.254:38871)
0807 18:47:15.083691 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.083695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.083895 (+ 200us) server_negotiation.cc:407] Connection header received
0807 18:47:15.083997 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.083999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.084037 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.084101 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:15.084365 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.084863 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.085617 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.085826 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.085897 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.086669 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:15.086671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:15.086673 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:15.086683 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:15.086698 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:15.086704 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:15.086766 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.086859 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.086905 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:47:15.089918 29198 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37184:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:47:15.092913 29198 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:47:15.106186 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.100796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:36853 (local address 127.0.0.1:42424)
0807 18:47:15.101146 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.101192 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:15.101307 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:15.102066 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:15.102074 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:15.102103 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:15.102265 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.102272 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.103548 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.103550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.104564 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.104573 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.105652 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.105655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.105778 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.105820 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 18:47:15.105927 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 18:47:15.106037 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":110,"threads_started":1}
I20260807 18:47:15.106266 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.100958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42424 (local address 127.10.174.195:36853)
0807 18:47:15.101319 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.101329 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.101374 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:47:15.101454 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.101462 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.101692 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.101864 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:15.102412 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.103428 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.104699 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.105514 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.105639 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.105817 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.105977 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.106096 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":165,"threads_started":1}
I20260807 18:47:15.107273 29676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.101900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:46021 (local address 127.0.0.1:49674)
0807 18:47:15.102349 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.102363 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:15.102437 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:15.103059 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:15.103062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:15.103090 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:15.103211 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.103217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.104673 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.104678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.105633 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.105642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.106896 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.106899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.106982 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.107004 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 18:47:15.107067 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 18:47:15.107135 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":85,"spinlock_wait_cycles":1408,"thread_start_us":88,"threads_started":1}
I20260807 18:47:15.107528 29677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.102337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49674 (local address 127.10.174.193:46021)
0807 18:47:15.102670 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.102681 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.102701 (+ 20us) server_negotiation.cc:407] Connection header received
0807 18:47:15.102765 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.102770 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.102912 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.103198 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:15.103378 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.104526 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.105770 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.106770 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.106907 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.107069 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.107115 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.107197 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":123,"threads_started":1}
I20260807 18:47:15.108245 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.101585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:35911 (local address 127.0.0.1:41840)
0807 18:47:15.102220 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.102236 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:15.102324 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:15.103049 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:15.103053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:15.103073 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:15.103380 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.103387 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.104706 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.104709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.105965 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.105976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.107096 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.107100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.107201 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.107230 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 18:47:15.107321 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 18:47:15.107390 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":85,"spinlock_wait_cycles":1792,"thread_start_us":95,"threads_started":1}
I20260807 18:47:15.108261 29675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.101769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.10.174.194:35911)
0807 18:47:15.102584 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.102596 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.102621 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:47:15.102695 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.102700 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.102890 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.103050 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:15.103501 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.104592 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.106110 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.106953 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.107815 (+ 862us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.107969 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.108014 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.108096 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":161,"threads_started":1}
I20260807 18:47:15.109535 29592 tablet_service.cc:1467] Processing CreateTablet for tablet 3842589036c740fc9626e4b8ac2c2e0e (DEFAULT_TABLE table=test-table [id=7e38ece2af0c48339da1edde2706e35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:15.110081 29324 tablet_service.cc:1467] Processing CreateTablet for tablet 3842589036c740fc9626e4b8ac2c2e0e (DEFAULT_TABLE table=test-table [id=7e38ece2af0c48339da1edde2706e35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:15.110507 29592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3842589036c740fc9626e4b8ac2c2e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:15.111064 29324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3842589036c740fc9626e4b8ac2c2e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:15.110863 29460 tablet_service.cc:1467] Processing CreateTablet for tablet 3842589036c740fc9626e4b8ac2c2e0e (DEFAULT_TABLE table=test-table [id=7e38ece2af0c48339da1edde2706e35a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:15.111799 29460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3842589036c740fc9626e4b8ac2c2e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:15.117053 29678 tablet_bootstrap.cc:492] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Bootstrap starting.
I20260807 18:47:15.118450 29679 tablet_bootstrap.cc:492] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: Bootstrap starting.
I20260807 18:47:15.119472 29678 tablet_bootstrap.cc:654] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:15.119624 29680 tablet_bootstrap.cc:492] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Bootstrap starting.
I20260807 18:47:15.120270 29678 log.cc:824] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:15.120528 29679 tablet_bootstrap.cc:654] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:15.121337 29679 log.cc:824] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:15.121686 29680 tablet_bootstrap.cc:654] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:15.122455 29678 tablet_bootstrap.cc:492] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: No bootstrap required, opened a new log
I20260807 18:47:15.122532 29680 log.cc:824] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:15.122701 29678 ts_tablet_manager.cc:1397] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260807 18:47:15.123227 29679 tablet_bootstrap.cc:492] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: No bootstrap required, opened a new log
I20260807 18:47:15.123476 29679 ts_tablet_manager.cc:1397] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:47:15.124593 29680 tablet_bootstrap.cc:492] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: No bootstrap required, opened a new log
I20260807 18:47:15.124768 29680 ts_tablet_manager.cc:1397] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:47:15.126299 29678 raft_consensus.cc:348] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.126550 29678 raft_consensus.cc:374] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:15.126624 29678 raft_consensus.cc:729] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc62e05f20824d86b80585b90743af20, State: Initialized, Role: FOLLOWER
I20260807 18:47:15.127092 29678 consensus_queue.cc:260] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.127835 29661 heartbeater.cc:503] Master 127.10.174.254:38871 was elected leader, sending a full tablet report...
I20260807 18:47:15.128149 29678 ts_tablet_manager.cc:1428] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:47:15.128849 29680 raft_consensus.cc:348] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.128908 29679 raft_consensus.cc:348] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.129112 29679 raft_consensus.cc:374] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:15.129190 29680 raft_consensus.cc:374] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:15.129201 29679 raft_consensus.cc:729] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5bde237d94b4a6e83b197bbf0b35a05, State: Initialized, Role: FOLLOWER
I20260807 18:47:15.129297 29680 raft_consensus.cc:729] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe6ba83cc1f4ffb8d227cb960ab6c93, State: Initialized, Role: FOLLOWER
I20260807 18:47:15.129746 29680 consensus_queue.cc:260] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.129757 29679 consensus_queue.cc:260] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.130400 29684 raft_consensus.cc:482] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:15.130539 29684 raft_consensus.cc:504] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.130720 29680 ts_tablet_manager.cc:1428] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:47:15.130720 29679 ts_tablet_manager.cc:1428] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:47:15.131034 29392 heartbeater.cc:503] Master 127.10.174.254:38871 was elected leader, sending a full tablet report...
I20260807 18:47:15.131034 29526 heartbeater.cc:503] Master 127.10.174.254:38871 was elected leader, sending a full tablet report...
I20260807 18:47:15.131713 29684 leader_election.cc:288] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe6ba83cc1f4ffb8d227cb960ab6c93 (127.10.174.194:35911), f5bde237d94b4a6e83b197bbf0b35a05 (127.10.174.193:46021)
I20260807 18:47:15.137118 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.132067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:35911 (local address 127.10.174.195:46723)
0807 18:47:15.132818 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.132835 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:15.132915 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:15.133430 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:15.133433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:15.133449 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:15.133573 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.133581 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.134717 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.134723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.135877 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.135886 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.136674 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.136678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.136805 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.136834 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 18:47:15.136923 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 18:47:15.136995 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670}
I20260807 18:47:15.137117 29675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.133072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:46723 (local address 127.10.174.194:35911)
0807 18:47:15.133203 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.133207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.133220 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:47:15.133271 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.133274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.133320 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.133418 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:15.133710 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.134426 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.135997 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.136545 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.136676 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.136723 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.136938 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.137003 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 18:47:15.137777 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3842589036c740fc9626e4b8ac2c2e0e" candidate_uuid: "cc62e05f20824d86b80585b90743af20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" is_pre_election: true
I20260807 18:47:15.138077 29480 raft_consensus.cc:2454] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc62e05f20824d86b80585b90743af20 in term 0.
I20260807 18:47:15.138216 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.132314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:46021 (local address 127.10.174.195:47907)
0807 18:47:15.133752 (+ 1438us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.133765 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:15.133892 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:15.134873 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:15.134876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:15.134891 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:15.134995 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.135001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.136013 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.136018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.136883 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:15.136893 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.137699 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.137703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:15.137914 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.137961 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 18:47:15.138043 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 18:47:15.138109 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1369,"thread_start_us":105,"threads_started":1}
I20260807 18:47:15.138276 29677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.132407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:47907 (local address 127.10.174.193:46021)
0807 18:47:15.132532 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.132537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.133830 (+ 1293us) server_negotiation.cc:407] Connection header received
0807 18:47:15.134634 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.134637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.134691 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.134744 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:15.135106 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.135894 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.137007 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.137571 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.137690 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.137732 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.138078 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.138156 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:47:15.138808 29546 leader_election.cc:302] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc62e05f20824d86b80585b90743af20, fbe6ba83cc1f4ffb8d227cb960ab6c93; no voters:
I20260807 18:47:15.138808 29345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3842589036c740fc9626e4b8ac2c2e0e" candidate_uuid: "cc62e05f20824d86b80585b90743af20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" is_pre_election: true
I20260807 18:47:15.139048 29345 raft_consensus.cc:2454] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc62e05f20824d86b80585b90743af20 in term 0.
I20260807 18:47:15.139153 29684 raft_consensus.cc:2781] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:15.139223 29684 raft_consensus.cc:482] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:15.139284 29684 raft_consensus.cc:3037] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:15.140316 29684 raft_consensus.cc:504] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.140587 29684 leader_election.cc:288] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [CANDIDATE]: Term 1 election: Requested vote from peers fbe6ba83cc1f4ffb8d227cb960ab6c93 (127.10.174.194:35911), f5bde237d94b4a6e83b197bbf0b35a05 (127.10.174.193:46021)
I20260807 18:47:15.140889 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3842589036c740fc9626e4b8ac2c2e0e" candidate_uuid: "cc62e05f20824d86b80585b90743af20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93"
I20260807 18:47:15.141016 29480 raft_consensus.cc:3037] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:15.141003 29345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3842589036c740fc9626e4b8ac2c2e0e" candidate_uuid: "cc62e05f20824d86b80585b90743af20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5bde237d94b4a6e83b197bbf0b35a05"
I20260807 18:47:15.141146 29345 raft_consensus.cc:3037] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:15.142131 29345 raft_consensus.cc:2454] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc62e05f20824d86b80585b90743af20 in term 1.
I20260807 18:47:15.142169 29480 raft_consensus.cc:2454] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc62e05f20824d86b80585b90743af20 in term 1.
I20260807 18:47:15.142455 29546 leader_election.cc:302] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc62e05f20824d86b80585b90743af20, f5bde237d94b4a6e83b197bbf0b35a05; no voters:
I20260807 18:47:15.142661 29684 raft_consensus.cc:2781] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:15.142907 29684 raft_consensus.cc:686] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 1 LEADER]: Becoming Leader. State: Replica: cc62e05f20824d86b80585b90743af20, State: Running, Role: LEADER
I20260807 18:47:15.143213 29684 consensus_queue.cc:237] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } }
I20260807 18:47:15.146350 29197 catalog_manager.cc:5495] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc62e05f20824d86b80585b90743af20 (127.10.174.195). New cstate: current_term: 1 leader_uuid: "cc62e05f20824d86b80585b90743af20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc62e05f20824d86b80585b90743af20" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 } health_report { overall_health: UNKNOWN } } }
I20260807 18:47:15.168325 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.165188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42426 (local address 127.10.174.195:36853)
0807 18:47:15.165317 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:15.165320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:15.165333 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:47:15.165417 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:15.165419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:15.165467 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:15.165554 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:15.165781 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.166267 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.167055 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:15.167255 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:15.167395 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:15.167644 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:15.168026 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:15.168113 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:15.168179 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 18:47:15.168222 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:47:15.173918 29345 raft_consensus.cc:1261] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 1 FOLLOWER]: Refusing update from remote peer cc62e05f20824d86b80585b90743af20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:15.173935 29480 raft_consensus.cc:1261] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 1 FOLLOWER]: Refusing update from remote peer cc62e05f20824d86b80585b90743af20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:15.174599 29684 consensus_queue.cc:1035] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5bde237d94b4a6e83b197bbf0b35a05" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:15.174800 29688 consensus_queue.cc:1035] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe6ba83cc1f4ffb8d227cb960ab6c93" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 35911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:15.182623 29693 mvcc.cc:205] Tried to move back new op lower bound from 7315982070465224704 to 7315982070349656064. Current Snapshot: MvccSnapshot[applied={T|T < 7315982070465224704}]
I20260807 18:47:15.190308 29197 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:15.190455 29197 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:15.192752 29197 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8454155cbe148a18d5b9375dc40d916: Sending DeleteTablet for 3 replicas of tablet 3842589036c740fc9626e4b8ac2c2e0e
I20260807 18:47:15.193516 29592 tablet_service.cc:1514] Processing DeleteTablet for tablet 3842589036c740fc9626e4b8ac2c2e0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:15 UTC) from {username='slave'} at 127.0.0.1:42424
I20260807 18:47:15.193665 29460 tablet_service.cc:1514] Processing DeleteTablet for tablet 3842589036c740fc9626e4b8ac2c2e0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:15 UTC) from {username='slave'} at 127.0.0.1:41840
I20260807 18:47:15.193804 29324 tablet_service.cc:1514] Processing DeleteTablet for tablet 3842589036c740fc9626e4b8ac2c2e0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:15 UTC) from {username='slave'} at 127.0.0.1:49674
I20260807 18:47:15.194166 29702 tablet_replica.cc:330] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: stopping tablet replica
I20260807 18:47:15.194259 29703 tablet_replica.cc:330] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05: stopping tablet replica
I20260807 18:47:15.194615 29702 raft_consensus.cc:2229] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:15.194782 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29259
I20260807 18:47:15.194793 29703 raft_consensus.cc:2229] T 3842589036c740fc9626e4b8ac2c2e0e P f5bde237d94b4a6e83b197bbf0b35a05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:15.195808 29701 tablet_replica.cc:330] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: stopping tablet replica
I20260807 18:47:15.196172 29701 raft_consensus.cc:2229] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:47:15.196300 29702 raft_consensus.cc:2258] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:15.196556 29701 raft_consensus.cc:2258] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:15.197964 29701 ts_tablet_manager.cc:1905] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:15.197964 29702 ts_tablet_manager.cc:1905] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:15.200728 29702 ts_tablet_manager.cc:1918] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:15.200728 29701 ts_tablet_manager.cc:1918] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:15.200829 29701 log.cc:1196] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/3842589036c740fc9626e4b8ac2c2e0e
I20260807 18:47:15.200906 29702 log.cc:1196] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/3842589036c740fc9626e4b8ac2c2e0e
I20260807 18:47:15.201243 29701 ts_tablet_manager.cc:1939] T 3842589036c740fc9626e4b8ac2c2e0e P cc62e05f20824d86b80585b90743af20: Deleting consensus metadata
I20260807 18:47:15.201289 29702 ts_tablet_manager.cc:1939] T 3842589036c740fc9626e4b8ac2c2e0e P fbe6ba83cc1f4ffb8d227cb960ab6c93: Deleting consensus metadata
I20260807 18:47:15.202435 29184 catalog_manager.cc:4841] TS fbe6ba83cc1f4ffb8d227cb960ab6c93 (127.10.174.194:35911): tablet 3842589036c740fc9626e4b8ac2c2e0e (table test-table [id=7e38ece2af0c48339da1edde2706e35a]) successfully deleted
I20260807 18:47:15.204710 29184 catalog_manager.cc:4841] TS cc62e05f20824d86b80585b90743af20 (127.10.174.195:36853): tablet 3842589036c740fc9626e4b8ac2c2e0e (table test-table [id=7e38ece2af0c48339da1edde2706e35a]) successfully deleted
W20260807 18:47:15.209517 29184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:46021 (error 108)
I20260807 18:47:15.209646 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29395
I20260807 18:47:15.213517 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:15.213183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:46021 (local address 127.0.0.1:49682)
0807 18:47:15.213342 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:15.213423 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:46021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 18:47:15.213701 29184 catalog_manager.cc:4584] TS f5bde237d94b4a6e83b197bbf0b35a05 (127.10.174.193:46021): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3842589036c740fc9626e4b8ac2c2e0e: Network error: Client connection negotiation failed: client connection to 127.10.174.193:46021: connect: Connection refused (error 111)
I20260807 18:47:15.217317 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29529
I20260807 18:47:15.223023 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29167
2026-08-07T18:47:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1015 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:15 dist-test-slave-07c2 krb5kdc[29707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:15 dist-test-slave-07c2 krb5kdc[29707](info): set up 2 sockets
Aug 07 18:47:15 dist-test-slave-07c2 krb5kdc[29707](info): commencing operation
krb5kdc: starting...
W20260807 18:47:16.293885 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:16 dist-test-slave-07c2 krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:16.422070 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39043
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:39043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:16.536017 29722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:16.536352 29722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:16.536445 29722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:16.540720 29722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:16.540817 29722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:16.540854 29722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:16.540907 29722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:16.540941 29722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:16.546499 29722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:39043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:16.547845 29722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:16.548926 29722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:16.557914 29731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:16.557917 29727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:16.557905 29728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:16.558159 29722 server_base.cc:1034] running on GCE node
I20260807 18:47:16.558872 29722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:16.560103 29722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:16.561292 29722 hybrid_clock.cc:648] HybridClock initialized: now 1786128436561276 us; error 28 us; skew 500 ppm
Aug 07 18:47:16 dist-test-slave-07c2 krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128436, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:16.565421 29722 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:16.566797 29722 webserver.cc:460] Webserver started at http://127.10.174.254:40039/ using document root <none> and password file <none>
I20260807 18:47:16.567535 29722 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:16.567631 29722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:16.567889 29722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:16.570449 29722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "2a0f8e87039d4930b9446df933109ffe"
format_stamp: "Formatted at 2026-08-07 18:47:16 on dist-test-slave-07c2"
server_key: "734f9c0982dee9d43e7eabf22f6cc8a9"
server_key_iv: "0d1f93454311c19f7d5272686be8bc2a"
server_key_version: "encryptionkey@0"
I20260807 18:47:16.570979 29722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "2a0f8e87039d4930b9446df933109ffe"
format_stamp: "Formatted at 2026-08-07 18:47:16 on dist-test-slave-07c2"
server_key: "734f9c0982dee9d43e7eabf22f6cc8a9"
server_key_iv: "0d1f93454311c19f7d5272686be8bc2a"
server_key_version: "encryptionkey@0"
I20260807 18:47:16.575006 29722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 18:47:16.577769 29738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:16.579010 29722 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:16.579135 29722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "2a0f8e87039d4930b9446df933109ffe"
format_stamp: "Formatted at 2026-08-07 18:47:16 on dist-test-slave-07c2"
server_key: "734f9c0982dee9d43e7eabf22f6cc8a9"
server_key_iv: "0d1f93454311c19f7d5272686be8bc2a"
server_key_version: "encryptionkey@0"
I20260807 18:47:16.579252 29722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:16.597576 29722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:16.601330 29722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:16.601581 29722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:16.608916 29722 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:39043
I20260807 18:47:16.608929 29791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:39043 every 8 connection(s)
I20260807 18:47:16.609911 29722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:16.612691 29792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:16.618240 29792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe: Bootstrap starting.
I20260807 18:47:16.618629 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29722
I20260807 18:47:16.618784 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:16.619061 10939 external_mini_cluster.cc:1428] Setting key 5965b623a8f4c3fe145481d80546e283
I20260807 18:47:16.620883 29792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:16.621609 29792 log.cc:824] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:16.623845 29792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe: No bootstrap required, opened a new log
Aug 07 18:47:16 dist-test-slave-07c2 krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:16.628266 29792 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0f8e87039d4930b9446df933109ffe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39043 } }
I20260807 18:47:16.628561 29792 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:16.628654 29792 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0f8e87039d4930b9446df933109ffe, State: Initialized, Role: FOLLOWER
I20260807 18:47:16.629120 29792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0f8e87039d4930b9446df933109ffe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39043 } }
I20260807 18:47:16.629299 29792 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:16.629370 29792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:16.629468 29792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:16.630720 29792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0f8e87039d4930b9446df933109ffe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39043 } }
I20260807 18:47:16.631105 29792 leader_election.cc:302] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a0f8e87039d4930b9446df933109ffe; no voters:
I20260807 18:47:16.631513 29792 leader_election.cc:288] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:16.631556 29797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:16.631816 29797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [term 1 LEADER]: Becoming Leader. State: Replica: 2a0f8e87039d4930b9446df933109ffe, State: Running, Role: LEADER
I20260807 18:47:16.632169 29797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0f8e87039d4930b9446df933109ffe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39043 } }
I20260807 18:47:16.632848 29792 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:16.634045 29800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a0f8e87039d4930b9446df933109ffe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0f8e87039d4930b9446df933109ffe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39043 } } }
I20260807 18:47:16.634181 29800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:16.634307 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:16.620486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57210 (local address 127.10.174.254:39043)
0807 18:47:16.620890 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:16.620905 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:16.620939 (+ 34us) server_negotiation.cc:407] Connection header received
0807 18:47:16.621583 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:16.621599 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:16.621986 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:16.622349 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:16.623258 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:16.624316 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:16.625467 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:16.625950 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:16.626064 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:16.628977 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:16.628982 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:16.628998 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:16.629028 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:16.631094 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:16.631613 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:16.631621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:16.631628 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:16.631771 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:16.632118 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:16.632120 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:16.632122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:16.632583 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:16.632800 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:16.633032 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 18:47:16.633327 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":131,"threads_started":1}
I20260807 18:47:16.634516 29799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a0f8e87039d4930b9446df933109ffe. Latest consensus state: current_term: 1 leader_uuid: "2a0f8e87039d4930b9446df933109ffe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a0f8e87039d4930b9446df933109ffe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39043 } } }
I20260807 18:47:16.634604 29799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:16.635361 29807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:16.638015 29807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:16.643208 29807 catalog_manager.cc:1347] Generated new cluster ID: f7162706467b4212b03a1048a8fc9ed8
I20260807 18:47:16.643272 29807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:16.659369 29807 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:16.660844 29807 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:16.665026 29807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe: Generated new TSK 0
I20260807 18:47:16.665652 29807 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:47:16.696677 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39043
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:16.826145 29819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:16.826452 29819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:16.826524 29819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:16.830615 29819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:16.830703 29819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:16.830796 29819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:47:16.836372 29819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:16.837399 29819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:16.838399 29819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:16.847486 29827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:16.847504 29825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:16.847522 29824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:16.847872 29819 server_base.cc:1034] running on GCE node
I20260807 18:47:16.848261 29819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:16.849077 29819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:16.850322 29819 hybrid_clock.cc:648] HybridClock initialized: now 1786128436850273 us; error 65 us; skew 500 ppm
Aug 07 18:47:16 dist-test-slave-07c2 krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128436, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:16.853118 29819 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:47:16.854118 29819 webserver.cc:460] Webserver started at http://127.10.174.193:40279/ using document root <none> and password file <none>
I20260807 18:47:16.854640 29819 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:16.854698 29819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:16.854859 29819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:16.856889 29819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "472b05c71abf43dcb67bc2fc19dea13c"
format_stamp: "Formatted at 2026-08-07 18:47:16 on dist-test-slave-07c2"
server_key: "c652af0a4dc48cca4fa4283bc2ad770b"
server_key_iv: "95af335e87d1c28751e3d8bb061098e3"
server_key_version: "encryptionkey@0"
I20260807 18:47:16.857411 29819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "472b05c71abf43dcb67bc2fc19dea13c"
format_stamp: "Formatted at 2026-08-07 18:47:16 on dist-test-slave-07c2"
server_key: "c652af0a4dc48cca4fa4283bc2ad770b"
server_key_iv: "95af335e87d1c28751e3d8bb061098e3"
server_key_version: "encryptionkey@0"
I20260807 18:47:16.860983 29819 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:47:16.863409 29834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:16.864562 29819 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:16.864704 29819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "472b05c71abf43dcb67bc2fc19dea13c"
format_stamp: "Formatted at 2026-08-07 18:47:16 on dist-test-slave-07c2"
server_key: "c652af0a4dc48cca4fa4283bc2ad770b"
server_key_iv: "95af335e87d1c28751e3d8bb061098e3"
server_key_version: "encryptionkey@0"
I20260807 18:47:16.864813 29819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:16.889598 29819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:16.892587 29819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:16.892799 29819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:16.893396 29819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:16.894220 29819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:16.894299 29819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:16.894368 29819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:16.894411 29819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:16.903203 29819 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:43387
I20260807 18:47:16.903229 29949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:43387 every 8 connection(s)
I20260807 18:47:16.904119 29819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:47:16.904460 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29819
I20260807 18:47:16.904614 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:47:16.904973 10939 external_mini_cluster.cc:1428] Setting key ec78852067eea6e0658e0211e8875d21
Aug 07 18:47:16 dist-test-slave-07c2 krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128436, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:47:16.918381 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:16.905998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:51085 (local address 127.10.174.254:39043)
0807 18:47:16.906116 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:16.906120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:16.907105 (+ 985us) server_negotiation.cc:407] Connection header received
0807 18:47:16.908484 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:16.908488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:16.908556 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:16.908634 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:16.909790 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:16.910326 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:16.911544 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:16.911779 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:16.911888 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:16.914589 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:16.914592 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:16.914595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:16.914618 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:16.916165 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:16.916686 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:16.916690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:16.916692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:16.916777 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:16.917180 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:16.917184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:16.917186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:16.917410 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:16.917509 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:16.918053 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 18:47:16.918187 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:47:16.919395 29952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:16.906480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39043 (local address 127.10.174.193:51085)
0807 18:47:16.906962 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:16.907006 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:16.908284 (+ 1278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:16.908833 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:16.908840 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:16.909179 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:16.909643 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:16.909656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:16.910455 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:16.910458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:16.911415 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:16.911425 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:16.911930 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:16.911934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:16.912115 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:16.912744 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:16.912759 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:16.914424 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:16.916290 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:16.916297 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:16.916313 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:16.916580 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:16.916902 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:16.916905 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:16.916907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:16.917079 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:16.917514 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:16.917523 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:16.917816 (+ 293us) client_negotiation.cc:769] Sending connection context
0807 18:47:16.918010 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 18:47:16.918344 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":129,"threads_started":1}
I20260807 18:47:16.920655 29950 heartbeater.cc:347] Connected to a master server at 127.10.174.254:39043
I20260807 18:47:16.920898 29950 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:16.921389 29950 heartbeater.cc:511] Master 127.10.174.254:39043 requested a full tablet report, sending...
I20260807 18:47:16.922852 29755 ts_manager.cc:194] Registered new tserver with Master: 472b05c71abf43dcb67bc2fc19dea13c (127.10.174.193:43387)
I20260807 18:47:16.924063 29755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:51085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:47:16.933741 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39043
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:17.045652 29955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:17.045922 29955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:17.046011 29955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:17.050230 29955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:17.050293 29955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:17.050400 29955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:47:17.056002 29955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:17.057142 29955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:17.058187 29955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:17.068279 29963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:17.068315 29960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:17.068315 29961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:17.068706 29955 server_base.cc:1034] running on GCE node
I20260807 18:47:17.069129 29955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:17.069795 29955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:17.071008 29955 hybrid_clock.cc:648] HybridClock initialized: now 1786128437070973 us; error 45 us; skew 500 ppm
Aug 07 18:47:17 dist-test-slave-07c2 krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128437, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:17.073854 29955 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:47:17.074738 29955 webserver.cc:460] Webserver started at http://127.10.174.194:40933/ using document root <none> and password file <none>
I20260807 18:47:17.075263 29955 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:17.075382 29955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:17.075614 29955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:17.077643 29955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "9ab5bedef8384e3abe99188c37e69144"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "719cb85feab5fcd0ecfbf924b6175026"
server_key_iv: "3c95c8082f7a85aa2f6fb82d88129cb3"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.078202 29955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "9ab5bedef8384e3abe99188c37e69144"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "719cb85feab5fcd0ecfbf924b6175026"
server_key_iv: "3c95c8082f7a85aa2f6fb82d88129cb3"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.081916 29955 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 18:47:17.084352 29970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.085573 29955 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:17.085712 29955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "9ab5bedef8384e3abe99188c37e69144"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "719cb85feab5fcd0ecfbf924b6175026"
server_key_iv: "3c95c8082f7a85aa2f6fb82d88129cb3"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.085825 29955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:17.116559 29955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:17.120036 29955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:17.120242 29955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:17.120891 29955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:17.121731 29955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:17.121801 29955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.121871 29955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:17.121910 29955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.131095 29955 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:43511
I20260807 18:47:17.131121 30086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:43511 every 8 connection(s)
I20260807 18:47:17.132026 29955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:47:17.141327 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 29955
I20260807 18:47:17.141466 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
Aug 07 18:47:17 dist-test-slave-07c2 krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128437, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:17.141757 10939 external_mini_cluster.cc:1428] Setting key 5bb69275c09fd6fac6d1d30e9c3d7a0c
I20260807 18:47:17.145972 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.133907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:36135 (local address 127.10.174.254:39043)
0807 18:47:17.134078 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.134083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.135035 (+ 952us) server_negotiation.cc:407] Connection header received
0807 18:47:17.136499 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.136502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.136550 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.136626 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:17.137688 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.138199 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.139345 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.139562 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.139642 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.142122 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:17.142127 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:17.142132 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:17.142161 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:17.143879 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:17.144396 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:17.144402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:17.144404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:17.144493 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:17.144814 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:17.144819 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:17.144821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:17.145008 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:17.145113 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.145726 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.145848 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 18:47:17.147109 30089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.134373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39043 (local address 127.10.174.194:36135)
0807 18:47:17.134808 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.134896 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.136300 (+ 1404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.136747 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.136755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.137086 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:17.137560 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.137573 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.138315 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.138317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.139192 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.139201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.139691 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.139694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.139835 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.140431 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:17.140448 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:17.141949 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:17.143992 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:17.143996 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:17.144008 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:17.144294 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:17.144581 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:17.144586 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:17.144588 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:17.144721 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:17.145111 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:17.145117 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:17.145430 (+ 313us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.145653 (+ 223us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.146024 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":107,"threads_started":1}
I20260807 18:47:17.148428 30087 heartbeater.cc:347] Connected to a master server at 127.10.174.254:39043
I20260807 18:47:17.148716 30087 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:17.149247 30087 heartbeater.cc:511] Master 127.10.174.254:39043 requested a full tablet report, sending...
I20260807 18:47:17.150349 29755 ts_manager.cc:194] Registered new tserver with Master: 9ab5bedef8384e3abe99188c37e69144 (127.10.174.194:43511)
I20260807 18:47:17.150938 29755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:36135
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:47:17.172191 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39043
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:17.285073 30092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:17.285362 30092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:17.285441 30092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:17.289599 30092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:17.289678 30092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:17.289765 30092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:47:17.295218 30092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:39043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:17.296326 30092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:17.297334 30092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:17.306835 30100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:17.306838 30097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:17.306903 30092 server_base.cc:1034] running on GCE node
W20260807 18:47:17.306838 30098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:17.307507 30092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:17.308182 30092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:17.309376 30092 hybrid_clock.cc:648] HybridClock initialized: now 1786128437309342 us; error 45 us; skew 500 ppm
Aug 07 18:47:17 dist-test-slave-07c2 krb5kdc[29707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128437, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:17.312188 30092 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:47:17.313060 30092 webserver.cc:460] Webserver started at http://127.10.174.195:39707/ using document root <none> and password file <none>
I20260807 18:47:17.313611 30092 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:17.313707 30092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:17.313932 30092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:17.316064 30092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "742b1129db6d4877963ffbbec40199cd"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "8f5d03ee29093a19f9e125c33d5e420d"
server_key_iv: "16ed70b8492b10ce2f3e768d1c778e13"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.316632 30092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "742b1129db6d4877963ffbbec40199cd"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "8f5d03ee29093a19f9e125c33d5e420d"
server_key_iv: "16ed70b8492b10ce2f3e768d1c778e13"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.320434 30092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:47:17.322845 30107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.324045 30092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:17.324175 30092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "742b1129db6d4877963ffbbec40199cd"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "8f5d03ee29093a19f9e125c33d5e420d"
server_key_iv: "16ed70b8492b10ce2f3e768d1c778e13"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.324298 30092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:17.337438 30092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:17.340802 30092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:17.341007 30092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:17.341609 30092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:17.342424 30092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:17.342490 30092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.342561 30092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:17.342599 30092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.352363 30092 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:39015
I20260807 18:47:17.352385 30222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:39015 every 8 connection(s)
I20260807 18:47:17.353257 30092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:47:17.359406 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30092
I20260807 18:47:17.359556 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:47:17.359862 10939 external_mini_cluster.cc:1428] Setting key a57729c403231033d3cb0fe917746827
Aug 07 18:47:17 dist-test-slave-07c2 krb5kdc[29707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128437, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:17.366962 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.355048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:43163 (local address 127.10.174.254:39043)
0807 18:47:17.355181 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.355185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.356044 (+ 859us) server_negotiation.cc:407] Connection header received
0807 18:47:17.357382 (+ 1338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.357385 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.357443 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.357541 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:17.358668 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.359214 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.360639 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.360924 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.361035 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.363664 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:17.363667 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:17.363669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:17.363695 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:17.365121 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:17.365585 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:17.365588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:17.365589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:17.365665 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:17.365954 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:17.365956 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:17.365957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:17.366134 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:17.366226 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.366726 (+ 500us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.366837 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:47:17.367894 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.355477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:39043 (local address 127.10.174.195:43163)
0807 18:47:17.355902 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.355944 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.357173 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.357706 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.357713 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.358069 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:17.358528 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.358541 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.359364 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.359367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.360521 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.360531 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.361119 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.361124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.361351 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.361995 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:17.362012 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:17.363509 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:17.365232 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:17.365236 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:17.365253 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:17.365503 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:17.365739 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:17.365741 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:17.365743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:17.365871 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:17.366231 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:17.366236 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:17.366475 (+ 239us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.366629 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.366891 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":103,"threads_started":1}
I20260807 18:47:17.369129 30223 heartbeater.cc:347] Connected to a master server at 127.10.174.254:39043
I20260807 18:47:17.369364 30223 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:17.369871 30223 heartbeater.cc:511] Master 127.10.174.254:39043 requested a full tablet report, sending...
I20260807 18:47:17.370850 29755 ts_manager.cc:194] Registered new tserver with Master: 742b1129db6d4877963ffbbec40199cd (127.10.174.195:39015)
I20260807 18:47:17.371434 29755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:43163
I20260807 18:47:17.373639 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:47:17.383819 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.375663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57212 (local address 127.10.174.254:39043)
0807 18:47:17.375801 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.375805 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.376011 (+ 206us) server_negotiation.cc:407] Connection header received
0807 18:47:17.376173 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.376176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.376216 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.376311 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:17.377016 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.377521 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.378345 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.378558 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.378660 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.380343 (+ 1683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:17.380347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:17.380350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:17.380379 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:17.381780 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:17.382340 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:17.382342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:17.382344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:17.382417 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:17.382779 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:17.382783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:17.382788 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:17.383067 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:17.383224 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.383538 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.383657 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 18:47:17.386638 29755 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:47:17.389828 29755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:47:17.404371 30235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.398349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:43387 (local address 127.0.0.1:57158)
0807 18:47:17.399664 (+ 1315us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.399677 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.399775 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.400306 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.400312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.400333 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:17.400473 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.400480 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.401560 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.401566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.402821 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.402830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.403827 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.403830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.403937 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.403976 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.404080 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.404196 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"mutex_wait_us":2,"thread_start_us":110,"threads_started":1}
I20260807 18:47:17.404390 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.398455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.10.174.193:43387)
0807 18:47:17.399143 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.399163 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.399815 (+ 652us) server_negotiation.cc:407] Connection header received
0807 18:47:17.399977 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.399982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.400150 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.400317 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:17.400581 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.401425 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.402943 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.403700 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.403844 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.403976 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.404127 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.404227 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":76,"threads_started":1}
I20260807 18:47:17.405035 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.398419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39015 (local address 127.0.0.1:40264)
0807 18:47:17.399477 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.399531 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.399879 (+ 348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.400475 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.400477 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.400493 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:17.400625 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.400631 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.402109 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.402112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.403352 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.403363 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.404657 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.404660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.404725 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.404744 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.404835 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.404905 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":955,"mutex_wait_us":5,"thread_start_us":112,"threads_started":1}
I20260807 18:47:17.405100 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.398616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40264 (local address 127.10.174.195:39015)
0807 18:47:17.399083 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.399095 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.399622 (+ 527us) server_negotiation.cc:407] Connection header received
0807 18:47:17.400021 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.400026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.400211 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.400369 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:17.400742 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.401941 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.403489 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.404321 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.404450 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.404583 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.404870 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.404966 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":169,"threads_started":1}
I20260807 18:47:17.405525 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.399452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.10.174.194:43511)
0807 18:47:17.399896 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.399905 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.399945 (+ 40us) server_negotiation.cc:407] Connection header received
0807 18:47:17.400019 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.400024 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.400211 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.400369 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:17.400822 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.401971 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.403605 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.404404 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.404541 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.404664 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.405108 (+ 444us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.405397 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":125,"threads_started":1}
I20260807 18:47:17.405498 30239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.399064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:43511 (local address 127.0.0.1:37890)
0807 18:47:17.399478 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.399531 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.399662 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.400519 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.400522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.400542 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:17.400694 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.400701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.402109 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.402112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.403494 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.403507 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.404723 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.404727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.404853 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.404876 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.404948 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.405027 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":278,"thread_start_us":97,"threads_started":1}
I20260807 18:47:17.408003 30156 tablet_service.cc:1467] Processing CreateTablet for tablet cd0a5fa42ae0434bb83ef37ce76de2bb (DEFAULT_TABLE table=test-table [id=b7e52e7d2d9a451080482bcf3a284201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:17.407858 29883 tablet_service.cc:1467] Processing CreateTablet for tablet cd0a5fa42ae0434bb83ef37ce76de2bb (DEFAULT_TABLE table=test-table [id=b7e52e7d2d9a451080482bcf3a284201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:17.408957 30156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0a5fa42ae0434bb83ef37ce76de2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:17.409039 29883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0a5fa42ae0434bb83ef37ce76de2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:17.409181 30019 tablet_service.cc:1467] Processing CreateTablet for tablet cd0a5fa42ae0434bb83ef37ce76de2bb (DEFAULT_TABLE table=test-table [id=b7e52e7d2d9a451080482bcf3a284201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:17.410136 30019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0a5fa42ae0434bb83ef37ce76de2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:17.415333 30241 tablet_bootstrap.cc:492] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Bootstrap starting.
I20260807 18:47:17.416957 30242 tablet_bootstrap.cc:492] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: Bootstrap starting.
I20260807 18:47:17.417789 30243 tablet_bootstrap.cc:492] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Bootstrap starting.
I20260807 18:47:17.417968 30241 tablet_bootstrap.cc:654] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:17.418929 30242 tablet_bootstrap.cc:654] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:17.419391 30241 log.cc:824] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:17.420192 30242 log.cc:824] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:17.420226 30243 tablet_bootstrap.cc:654] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:17.421478 30243 log.cc:824] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:17.422044 30241 tablet_bootstrap.cc:492] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: No bootstrap required, opened a new log
I20260807 18:47:17.422056 30242 tablet_bootstrap.cc:492] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: No bootstrap required, opened a new log
I20260807 18:47:17.422255 30242 ts_tablet_manager.cc:1397] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:47:17.422256 30241 ts_tablet_manager.cc:1397] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 18:47:17.423372 30243 tablet_bootstrap.cc:492] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: No bootstrap required, opened a new log
I20260807 18:47:17.423543 30243 ts_tablet_manager.cc:1397] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:47:17.425164 30242 raft_consensus.cc:348] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.425395 30242 raft_consensus.cc:374] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:17.425474 30242 raft_consensus.cc:729] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 472b05c71abf43dcb67bc2fc19dea13c, State: Initialized, Role: FOLLOWER
I20260807 18:47:17.425928 30242 consensus_queue.cc:260] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.426043 30241 raft_consensus.cc:348] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.426369 30241 raft_consensus.cc:374] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:17.426470 30241 raft_consensus.cc:729] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742b1129db6d4877963ffbbec40199cd, State: Initialized, Role: FOLLOWER
I20260807 18:47:17.426577 29950 heartbeater.cc:503] Master 127.10.174.254:39043 was elected leader, sending a full tablet report...
I20260807 18:47:17.426878 30241 consensus_queue.cc:260] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.426975 30242 ts_tablet_manager.cc:1428] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 18:47:17.427908 30241 ts_tablet_manager.cc:1428] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:47:17.428282 30223 heartbeater.cc:503] Master 127.10.174.254:39043 was elected leader, sending a full tablet report...
I20260807 18:47:17.428233 30243 raft_consensus.cc:348] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.428468 30243 raft_consensus.cc:374] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:17.428524 30243 raft_consensus.cc:729] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab5bedef8384e3abe99188c37e69144, State: Initialized, Role: FOLLOWER
I20260807 18:47:17.428947 30243 consensus_queue.cc:260] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.429688 30087 heartbeater.cc:503] Master 127.10.174.254:39043 was elected leader, sending a full tablet report...
I20260807 18:47:17.429822 30243 ts_tablet_manager.cc:1428] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 18:47:17.604523 30224 tablet.cc:2369] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:17.633019 30249 raft_consensus.cc:482] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 18:47:17.633263 30088 tablet.cc:2369] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:17.633299 30249 raft_consensus.cc:504] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.634629 30249 leader_election.cc:288] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 472b05c71abf43dcb67bc2fc19dea13c (127.10.174.193:43387), 742b1129db6d4877963ffbbec40199cd (127.10.174.195:39015)
I20260807 18:47:17.638487 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.634988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:49091 (local address 127.10.174.193:43387)
0807 18:47:17.635166 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.635171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.635208 (+ 37us) server_negotiation.cc:407] Connection header received
0807 18:47:17.635268 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.635272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.635356 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.635431 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:17.635773 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.636366 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.637449 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.637871 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.637964 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.638047 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.638262 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.638351 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 18:47:17.638520 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.634988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:49909 (local address 127.10.174.195:39015)
0807 18:47:17.635314 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.635319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.635427 (+ 108us) server_negotiation.cc:407] Connection header received
0807 18:47:17.635523 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.635526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.635574 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.635657 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:17.635970 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.636475 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.637502 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.637906 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.638041 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.638095 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.638325 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.638398 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216}
I20260807 18:47:17.638520 30089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.634851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:43387 (local address 127.10.174.194:49091)
0807 18:47:17.634992 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.635009 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.635131 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.635475 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.635480 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.635503 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:17.635644 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.635653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.636472 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.636476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.637322 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.637331 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.637988 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.637995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.638100 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.638154 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.638224 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.638369 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":23}
I20260807 18:47:17.638543 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.634855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:39015 (local address 127.10.174.194:49909)
0807 18:47:17.635320 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.635333 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:17.635436 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:17.635675 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:17.635677 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:17.635690 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:17.635841 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.635847 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.636575 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.636578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.637352 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:17.637360 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.638045 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.638048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:17.638169 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.638187 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 18:47:17.638280 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 18:47:17.638390 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":162,"thread_start_us":99,"threads_started":1}
I20260807 18:47:17.639325 30176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0a5fa42ae0434bb83ef37ce76de2bb" candidate_uuid: "9ab5bedef8384e3abe99188c37e69144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742b1129db6d4877963ffbbec40199cd" is_pre_election: true
I20260807 18:47:17.639321 29903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0a5fa42ae0434bb83ef37ce76de2bb" candidate_uuid: "9ab5bedef8384e3abe99188c37e69144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "472b05c71abf43dcb67bc2fc19dea13c" is_pre_election: true
I20260807 18:47:17.639645 29903 raft_consensus.cc:2454] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab5bedef8384e3abe99188c37e69144 in term 0.
I20260807 18:47:17.639645 30176 raft_consensus.cc:2454] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ab5bedef8384e3abe99188c37e69144 in term 0.
I20260807 18:47:17.640123 29973 leader_election.cc:302] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742b1129db6d4877963ffbbec40199cd, 9ab5bedef8384e3abe99188c37e69144; no voters:
I20260807 18:47:17.640388 30249 raft_consensus.cc:2781] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:17.640475 30249 raft_consensus.cc:482] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:17.640523 30249 raft_consensus.cc:3037] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:17.641562 30249 raft_consensus.cc:504] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.641907 30249 leader_election.cc:288] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [CANDIDATE]: Term 1 election: Requested vote from peers 472b05c71abf43dcb67bc2fc19dea13c (127.10.174.193:43387), 742b1129db6d4877963ffbbec40199cd (127.10.174.195:39015)
I20260807 18:47:17.642285 29903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0a5fa42ae0434bb83ef37ce76de2bb" candidate_uuid: "9ab5bedef8384e3abe99188c37e69144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "472b05c71abf43dcb67bc2fc19dea13c"
I20260807 18:47:17.642284 30176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0a5fa42ae0434bb83ef37ce76de2bb" candidate_uuid: "9ab5bedef8384e3abe99188c37e69144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742b1129db6d4877963ffbbec40199cd"
I20260807 18:47:17.642418 30176 raft_consensus.cc:3037] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:17.642418 29903 raft_consensus.cc:3037] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:17.643823 29903 raft_consensus.cc:2454] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab5bedef8384e3abe99188c37e69144 in term 1.
I20260807 18:47:17.643823 30176 raft_consensus.cc:2454] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ab5bedef8384e3abe99188c37e69144 in term 1.
I20260807 18:47:17.644217 29971 leader_election.cc:302] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 472b05c71abf43dcb67bc2fc19dea13c, 9ab5bedef8384e3abe99188c37e69144; no voters:
I20260807 18:47:17.644392 30249 raft_consensus.cc:2781] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:17.644620 30249 raft_consensus.cc:686] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab5bedef8384e3abe99188c37e69144, State: Running, Role: LEADER
I20260807 18:47:17.644958 30249 consensus_queue.cc:237] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } }
I20260807 18:47:17.647969 29754 catalog_manager.cc:5495] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ab5bedef8384e3abe99188c37e69144 (127.10.174.194). New cstate: current_term: 1 leader_uuid: "9ab5bedef8384e3abe99188c37e69144" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ab5bedef8384e3abe99188c37e69144" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 43511 } health_report { overall_health: HEALTHY } } }
W20260807 18:47:17.655613 29951 tablet.cc:2369] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:17.697136 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.693525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37904 (local address 127.10.174.194:43511)
0807 18:47:17.693685 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.693690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.693706 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:47:17.693795 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.693798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.693861 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.693973 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:17.694224 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.694746 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.695595 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.695827 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.695937 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.696241 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:17.696641 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:17.696803 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.696932 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.696973 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 18:47:17.702919 29903 raft_consensus.cc:1261] T cd0a5fa42ae0434bb83ef37ce76de2bb P 472b05c71abf43dcb67bc2fc19dea13c [term 1 FOLLOWER]: Refusing update from remote peer 9ab5bedef8384e3abe99188c37e69144: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:17.702919 30176 raft_consensus.cc:1261] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 1 FOLLOWER]: Refusing update from remote peer 9ab5bedef8384e3abe99188c37e69144: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:17.703862 30251 consensus_queue.cc:1035] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742b1129db6d4877963ffbbec40199cd" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 39015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:17.704089 30249 consensus_queue.cc:1035] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "472b05c71abf43dcb67bc2fc19dea13c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:17.711048 30254 mvcc.cc:205] Tried to move back new op lower bound from 7315982080823881728 to 7315982080596393984. Current Snapshot: MvccSnapshot[applied={T|T < 7315982080823881728}]
I20260807 18:47:17.711792 30255 mvcc.cc:205] Tried to move back new op lower bound from 7315982080823881728 to 7315982080596393984. Current Snapshot: MvccSnapshot[applied={T|T < 7315982080823881728}]
I20260807 18:47:17.715170 30256 mvcc.cc:205] Tried to move back new op lower bound from 7315982080823881728 to 7315982080596393984. Current Snapshot: MvccSnapshot[applied={T|T < 7315982080823881728}]
I20260807 18:47:17.719945 29753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:17.720137 29753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:17.722590 29753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a0f8e87039d4930b9446df933109ffe: Sending DeleteTablet for 3 replicas of tablet cd0a5fa42ae0434bb83ef37ce76de2bb
I20260807 18:47:17.723533 30156 tablet_service.cc:1514] Processing DeleteTablet for tablet cd0a5fa42ae0434bb83ef37ce76de2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:17 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:40264
I20260807 18:47:17.723541 29883 tablet_service.cc:1514] Processing DeleteTablet for tablet cd0a5fa42ae0434bb83ef37ce76de2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:17 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:57158
I20260807 18:47:17.724056 30019 tablet_service.cc:1514] Processing DeleteTablet for tablet cd0a5fa42ae0434bb83ef37ce76de2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:17 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:37890
I20260807 18:47:17.724215 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29819
I20260807 18:47:17.724948 30265 tablet_replica.cc:330] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: stopping tablet replica
I20260807 18:47:17.725282 30265 raft_consensus.cc:2229] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:17.725554 30266 tablet_replica.cc:330] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: stopping tablet replica
I20260807 18:47:17.725623 30265 raft_consensus.cc:2258] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:17.725948 30266 raft_consensus.cc:2229] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:47:17.726344 30266 raft_consensus.cc:2258] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:17.727324 30265 ts_tablet_manager.cc:1905] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:17.727820 30266 ts_tablet_manager.cc:1905] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:17.730360 30265 ts_tablet_manager.cc:1918] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:17.730504 30265 log.cc:1196] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/cd0a5fa42ae0434bb83ef37ce76de2bb
I20260807 18:47:17.730613 30266 ts_tablet_manager.cc:1918] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:17.730788 30266 log.cc:1196] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/cd0a5fa42ae0434bb83ef37ce76de2bb
I20260807 18:47:17.730891 30265 ts_tablet_manager.cc:1939] T cd0a5fa42ae0434bb83ef37ce76de2bb P 742b1129db6d4877963ffbbec40199cd: Deleting consensus metadata
I20260807 18:47:17.731187 30266 ts_tablet_manager.cc:1939] T cd0a5fa42ae0434bb83ef37ce76de2bb P 9ab5bedef8384e3abe99188c37e69144: Deleting consensus metadata
I20260807 18:47:17.732266 29740 catalog_manager.cc:4841] TS 9ab5bedef8384e3abe99188c37e69144 (127.10.174.194:43511): tablet cd0a5fa42ae0434bb83ef37ce76de2bb (table test-table [id=b7e52e7d2d9a451080482bcf3a284201]) successfully deleted
I20260807 18:47:17.733438 29741 catalog_manager.cc:4841] TS 742b1129db6d4877963ffbbec40199cd (127.10.174.195:39015): tablet cd0a5fa42ae0434bb83ef37ce76de2bb (table test-table [id=b7e52e7d2d9a451080482bcf3a284201]) successfully deleted
W20260807 18:47:17.737143 29739 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:43387 (error 108)
I20260807 18:47:17.737254 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29955
I20260807 18:47:17.739676 30235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.739410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:43387 (local address 127.0.0.1:57160)
0807 18:47:17.739536 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:17.739600 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:43387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 18:47:17.739836 29739 catalog_manager.cc:4584] TS 472b05c71abf43dcb67bc2fc19dea13c (127.10.174.193:43387): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cd0a5fa42ae0434bb83ef37ce76de2bb: Network error: Client connection negotiation failed: client connection to 127.10.174.193:43387: connect: Connection refused (error 111)
I20260807 18:47:17.744077 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30092
I20260807 18:47:17.750715 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 29722
2026-08-07T18:47:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2528 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T18:47:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:17Z Disabled control of system clock
I20260807 18:47:17.783123 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36391
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 18:47:17.894364 30271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:17.894639 30271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:17.894675 30271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:17.898680 30271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:17.898738 30271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:17.898754 30271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:17.898772 30271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:17.898793 30271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:17.903525 30271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:36391
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:17.904590 30271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:17.905920 30271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:17.914391 30277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:17.914398 30279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:17.914398 30276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:17.914834 30271 server_base.cc:1034] running on GCE node
I20260807 18:47:17.915445 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:17.916560 30271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:17.917718 30271 hybrid_clock.cc:648] HybridClock initialized: now 1786128437917691 us; error 39 us; skew 500 ppm
I20260807 18:47:17.919750 30271 webserver.cc:460] Webserver started at http://127.10.174.254:39511/ using document root <none> and password file <none>
I20260807 18:47:17.920344 30271 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:17.920410 30271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:17.920629 30271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:17.922771 30271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "76d44f17119b47c09e0661f94ad8fdc7"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "042764f14422425f097b6ded9959a8ba"
server_key_iv: "5fce4bdb68dcdd7fae8c73de75ebe809"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.923422 30271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "76d44f17119b47c09e0661f94ad8fdc7"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "042764f14422425f097b6ded9959a8ba"
server_key_iv: "5fce4bdb68dcdd7fae8c73de75ebe809"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.927114 30271 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 18:47:17.929607 30285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:17.930857 30271 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:17.930995 30271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "76d44f17119b47c09e0661f94ad8fdc7"
format_stamp: "Formatted at 2026-08-07 18:47:17 on dist-test-slave-07c2"
server_key: "042764f14422425f097b6ded9959a8ba"
server_key_iv: "5fce4bdb68dcdd7fae8c73de75ebe809"
server_key_version: "encryptionkey@0"
I20260807 18:47:17.931113 30271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:17.941452 30271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:17.942128 30271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:17.942327 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:17.949697 30271 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:36391
I20260807 18:47:17.949734 30338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:36391 every 8 connection(s)
I20260807 18:47:17.950723 30271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:17.953955 30339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:17.959367 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30271
I20260807 18:47:17.959520 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:17.959854 10939 external_mini_cluster.cc:1428] Setting key 2e0d4edb6e086875235147c7b3738290
I20260807 18:47:17.959854 30339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7: Bootstrap starting.
I20260807 18:47:17.962489 30339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:17.963246 30339 log.cc:824] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:17.965166 30339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7: No bootstrap required, opened a new log
I20260807 18:47:17.968693 30339 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d44f17119b47c09e0661f94ad8fdc7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36391 } }
I20260807 18:47:17.968954 30339 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:17.969038 30339 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76d44f17119b47c09e0661f94ad8fdc7, State: Initialized, Role: FOLLOWER
I20260807 18:47:17.969292 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:17.961298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51598 (local address 127.10.174.254:36391)
0807 18:47:17.961974 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:17.961989 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:17.962024 (+ 35us) server_negotiation.cc:407] Connection header received
0807 18:47:17.962728 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:17.962747 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:17.963151 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:17.963542 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:17.963998 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.964948 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.965894 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:17.966370 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:17.966553 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:17.967445 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:17.967451 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:17.967463 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:17.967853 (+ 390us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:17.967908 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:17.967928 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:17.968035 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:17.968154 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 18:47:17.968414 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":140,"threads_started":1}
I20260807 18:47:17.969534 30339 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d44f17119b47c09e0661f94ad8fdc7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36391 } }
I20260807 18:47:17.969696 30339 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:17.969765 30339 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:17.969858 30339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:17.970844 30339 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d44f17119b47c09e0661f94ad8fdc7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36391 } }
I20260807 18:47:17.971179 30339 leader_election.cc:302] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76d44f17119b47c09e0661f94ad8fdc7; no voters:
I20260807 18:47:17.971546 30339 leader_election.cc:288] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:17.971644 30344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:17.971885 30344 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 76d44f17119b47c09e0661f94ad8fdc7, State: Running, Role: LEADER
I20260807 18:47:17.972244 30344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d44f17119b47c09e0661f94ad8fdc7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36391 } }
I20260807 18:47:17.972698 30339 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:17.973852 30345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76d44f17119b47c09e0661f94ad8fdc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d44f17119b47c09e0661f94ad8fdc7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36391 } } }
I20260807 18:47:17.974007 30345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:17.974396 30354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:17.974344 30346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76d44f17119b47c09e0661f94ad8fdc7. Latest consensus state: current_term: 1 leader_uuid: "76d44f17119b47c09e0661f94ad8fdc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d44f17119b47c09e0661f94ad8fdc7" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36391 } } }
I20260807 18:47:17.974462 30346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:17.977919 30354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:17.983165 30354 catalog_manager.cc:1347] Generated new cluster ID: 5c744c097f5b484ebfe923c6f28d608f
I20260807 18:47:17.983310 30354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:18.001565 30354 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:18.002810 30354 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:18.010227 30354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7: Generated new TSK 0
I20260807 18:47:18.011018 30354 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:18.017954 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36391
--builtin_ntp_servers=127.10.174.212:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 18:47:18.131489 30364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:18.131745 30364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:18.131789 30364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:18.135895 30364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:18.135951 30364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:18.136008 30364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:47:18.140651 30364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:18.141649 30364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:18.142987 30364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:18.152335 30369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:18.152344 30370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:18.152344 30372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:18.152585 30364 server_base.cc:1034] running on GCE node
I20260807 18:47:18.153080 30364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:18.153712 30364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:18.154942 30364 hybrid_clock.cc:648] HybridClock initialized: now 1786128438154921 us; error 27 us; skew 500 ppm
I20260807 18:47:18.156752 30364 webserver.cc:460] Webserver started at http://127.10.174.193:44095/ using document root <none> and password file <none>
I20260807 18:47:18.157301 30364 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:18.157371 30364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:18.157536 30364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:18.159646 30364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "ba46a9c11cc649ff8742235afe399c08"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "2ad5785a9dba41125396fdde103537fe"
server_key_iv: "b1f7ccc89ac345bd2b59166d76f4600a"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.160166 30364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "ba46a9c11cc649ff8742235afe399c08"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "2ad5785a9dba41125396fdde103537fe"
server_key_iv: "b1f7ccc89ac345bd2b59166d76f4600a"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.163740 30364 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:18.166062 30379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.167253 30364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:18.167416 30364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "ba46a9c11cc649ff8742235afe399c08"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "2ad5785a9dba41125396fdde103537fe"
server_key_iv: "b1f7ccc89ac345bd2b59166d76f4600a"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.167522 30364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:18.184546 30364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:18.185308 30364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:18.185518 30364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:18.186137 30364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:18.187117 30364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:18.187165 30364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.187247 30364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:18.187280 30364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.196167 30364 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:41049
I20260807 18:47:18.196190 30496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:41049 every 8 connection(s)
I20260807 18:47:18.197095 30364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:47:18.205019 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30364
I20260807 18:47:18.205175 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:47:18.205570 10939 external_mini_cluster.cc:1428] Setting key 00ff5270b7906b3879bcd7f43a1f1dd4
I20260807 18:47:18.206892 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.198928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:59249 (local address 127.10.174.254:36391)
0807 18:47:18.199076 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.199079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.200180 (+ 1101us) server_negotiation.cc:407] Connection header received
0807 18:47:18.201638 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.201641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.201705 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.201804 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:18.202705 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.203261 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.204448 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.204685 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.204796 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.206223 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:18.206227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:18.206232 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:18.206259 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:18.206283 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:18.206297 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:18.206365 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.206685 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.206749 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 18:47:18.207810 30499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.199358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36391 (local address 127.10.174.193:59249)
0807 18:47:18.200031 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.200072 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.201403 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.201992 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.201999 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.202084 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:18.202559 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.202572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.203423 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.203426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.204305 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.204314 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.204843 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.204847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.205013 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.205773 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:18.205775 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:18.205974 (+ 199us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:18.206042 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:18.206496 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:18.206505 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:18.206513 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.206645 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.206887 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":127,"threads_started":1}
I20260807 18:47:18.207901 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36391
--builtin_ntp_servers=127.10.174.212:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 18:47:18.208998 30497 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36391
I20260807 18:47:18.209255 30497 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:18.209883 30497 heartbeater.cc:511] Master 127.10.174.254:36391 requested a full tablet report, sending...
I20260807 18:47:18.211563 30302 ts_manager.cc:194] Registered new tserver with Master: ba46a9c11cc649ff8742235afe399c08 (127.10.174.193:41049)
I20260807 18:47:18.213301 30302 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.193:59249
W20260807 18:47:18.320577 30500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:18.320875 30500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:18.320914 30500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:18.325126 30500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:18.325189 30500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:18.325246 30500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:47:18.329974 30500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:18.331003 30500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:18.332348 30500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:18.341795 30505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:18.341847 30506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:18.341795 30508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:18.342149 30500 server_base.cc:1034] running on GCE node
I20260807 18:47:18.342538 30500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:18.343175 30500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:18.344363 30500 hybrid_clock.cc:648] HybridClock initialized: now 1786128438344333 us; error 46 us; skew 500 ppm
I20260807 18:47:18.346220 30500 webserver.cc:460] Webserver started at http://127.10.174.194:32979/ using document root <none> and password file <none>
I20260807 18:47:18.346787 30500 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:18.346876 30500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:18.347097 30500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:18.349251 30500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "6d8ec62f203049e984aaf39c48b0b132"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "efabf084c9e66421327dea637bcc594f"
server_key_iv: "6d789a345df41b1bd3aeb33058536a17"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.349817 30500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "6d8ec62f203049e984aaf39c48b0b132"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "efabf084c9e66421327dea637bcc594f"
server_key_iv: "6d789a345df41b1bd3aeb33058536a17"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.354274 30500 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:47:18.356686 30514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.357892 30500 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:18.358032 30500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "6d8ec62f203049e984aaf39c48b0b132"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "efabf084c9e66421327dea637bcc594f"
server_key_iv: "6d789a345df41b1bd3aeb33058536a17"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.358147 30500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:18.382570 30500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:18.383383 30500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:18.383581 30500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:18.384210 30500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:18.385162 30500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:18.385229 30500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.385301 30500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:18.385341 30500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.394685 30500 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:37407
I20260807 18:47:18.394702 30630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:37407 every 8 connection(s)
I20260807 18:47:18.395690 30500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:47:18.404843 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.397507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:58649 (local address 127.10.174.254:36391)
0807 18:47:18.397658 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.397662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.398715 (+ 1053us) server_negotiation.cc:407] Connection header received
0807 18:47:18.400086 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.400089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.400145 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.400223 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:18.401147 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.401710 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.402884 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.403103 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.403185 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.404403 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:18.404407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:18.404409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:18.404424 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:18.404446 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:18.404454 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:18.404522 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.404661 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.404720 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:47:18.405761 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.397935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36391 (local address 127.10.174.194:58649)
0807 18:47:18.398555 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.398596 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.399876 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.400381 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.400388 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.400469 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:18.400965 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.400977 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.401849 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.401852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.402762 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.402772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.403249 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.403253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.403476 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.404129 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:18.404130 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:18.404174 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:18.404243 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:18.404533 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:18.404540 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:18.404544 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.404641 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.404886 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":115,"threads_started":1}
I20260807 18:47:18.406041 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30500
I20260807 18:47:18.406195 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:47:18.406600 10939 external_mini_cluster.cc:1428] Setting key c581daaee3cc4e0b1857c04951e67365
I20260807 18:47:18.407104 30631 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36391
I20260807 18:47:18.407413 30631 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:18.408049 30631 heartbeater.cc:511] Master 127.10.174.254:36391 requested a full tablet report, sending...
I20260807 18:47:18.408737 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36391
--builtin_ntp_servers=127.10.174.212:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 18:47:18.409184 30302 ts_manager.cc:194] Registered new tserver with Master: 6d8ec62f203049e984aaf39c48b0b132 (127.10.174.194:37407)
I20260807 18:47:18.409763 30302 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.194:58649
W20260807 18:47:18.528003 30634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:18.528264 30634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:18.528304 30634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:18.532394 30634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:18.532454 30634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:18.532533 30634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:47:18.537549 30634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:18.538718 30634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:18.540201 30634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:18.550014 30640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:18.550031 30639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:18.550357 30634 server_base.cc:1034] running on GCE node
W20260807 18:47:18.550467 30642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:18.550930 30634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:18.551663 30634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:18.552845 30634 hybrid_clock.cc:648] HybridClock initialized: now 1786128438552825 us; error 36 us; skew 500 ppm
I20260807 18:47:18.554903 30634 webserver.cc:460] Webserver started at http://127.10.174.195:45309/ using document root <none> and password file <none>
I20260807 18:47:18.555598 30634 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:18.555665 30634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:18.555877 30634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:18.558153 30634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "b6d6fa91cd3044759bab91a84e774d4f"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "a870009bb41069244c0356c254d4df57"
server_key_iv: "bf8a6f732484a7f229ff65a07328c489"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.558800 30634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "b6d6fa91cd3044759bab91a84e774d4f"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "a870009bb41069244c0356c254d4df57"
server_key_iv: "bf8a6f732484a7f229ff65a07328c489"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.563136 30634 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260807 18:47:18.565698 30648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.566977 30634 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:18.567097 30634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "b6d6fa91cd3044759bab91a84e774d4f"
format_stamp: "Formatted at 2026-08-07 18:47:18 on dist-test-slave-07c2"
server_key: "a870009bb41069244c0356c254d4df57"
server_key_iv: "bf8a6f732484a7f229ff65a07328c489"
server_key_version: "encryptionkey@0"
I20260807 18:47:18.567211 30634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:18.607988 30634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:18.608758 30634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:18.608960 30634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:18.609654 30634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:18.610678 30634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:18.610728 30634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.610793 30634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:18.610831 30634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:18.619828 30634 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:32829
I20260807 18:47:18.619849 30764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:32829 every 8 connection(s)
I20260807 18:47:18.620787 30634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:47:18.626385 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30634
I20260807 18:47:18.626505 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:47:18.626825 10939 external_mini_cluster.cc:1428] Setting key 825a2ab19e3a430e66297ce87efef57d
I20260807 18:47:18.630375 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.622645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:35341 (local address 127.10.174.254:36391)
0807 18:47:18.622803 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.622808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.623925 (+ 1117us) server_negotiation.cc:407] Connection header received
0807 18:47:18.625287 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.625290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.625339 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.625417 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:18.626289 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.627088 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.628467 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.628724 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.628848 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.629964 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:18.629967 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:18.629969 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:18.629981 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:18.630000 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:18.630008 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:18.630067 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.630214 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.630264 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:47:18.631248 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.623107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36391 (local address 127.10.174.195:35341)
0807 18:47:18.623783 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.623825 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.625068 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.625577 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.625583 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.625667 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:18.626148 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.626161 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.627231 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.627234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.628342 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.628351 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.628875 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.628878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.629074 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.629715 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:18.629716 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:18.629756 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:18.629820 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:18.630080 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:18.630086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:18.630090 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.630194 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.630415 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":156,"threads_started":1}
I20260807 18:47:18.632385 30765 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36391
I20260807 18:47:18.632587 30765 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:18.633064 30765 heartbeater.cc:511] Master 127.10.174.254:36391 requested a full tablet report, sending...
I20260807 18:47:18.634065 30302 ts_manager.cc:194] Registered new tserver with Master: b6d6fa91cd3044759bab91a84e774d4f (127.10.174.195:32829)
I20260807 18:47:18.634589 30302 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.195:35341
I20260807 18:47:18.640753 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:47:18.646883 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.642728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55176 (local address 127.10.174.254:36391)
0807 18:47:18.642876 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.642881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.643007 (+ 126us) server_negotiation.cc:407] Connection header received
0807 18:47:18.643156 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.643159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.643209 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.643292 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:18.643597 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.644125 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.644970 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.645202 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.645309 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.646204 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:18.646208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:18.646210 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:18.646224 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:18.646250 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:18.646258 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:18.646393 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.646668 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.646715 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:47:18.649993 30302 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:47:18.653180 30302 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:47:18.668275 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.662222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:32829 (local address 127.0.0.1:33940)
0807 18:47:18.662759 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.662813 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.662944 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.663900 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.663903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.663916 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:18.664009 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.664016 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.665157 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.665161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.666662 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.666672 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.667679 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.667683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.667791 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.667834 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.667961 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.668099 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":259,"thread_start_us":97,"threads_started":1}
I20260807 18:47:18.668295 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.662403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33940 (local address 127.10.174.195:32829)
0807 18:47:18.663446 (+ 1043us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.663459 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.663484 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:47:18.663563 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.663570 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.663757 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.663909 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:18.664189 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.665036 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.666789 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.667553 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.667683 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.667885 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.667996 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.668108 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":938,"thread_start_us":104,"threads_started":1}
I20260807 18:47:18.668715 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.661785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:37407 (local address 127.0.0.1:47592)
0807 18:47:18.662759 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.662813 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.662958 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.663761 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.663765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.663783 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:18.663931 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.663938 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.665465 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.665468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.666970 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.666980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.668285 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.668291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.668406 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.668428 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.668497 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.668579 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":117,"thread_start_us":100,"threads_started":1}
I20260807 18:47:18.668912 30780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.662537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:41049 (local address 127.0.0.1:53824)
0807 18:47:18.663206 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.663220 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.663338 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.664202 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.664205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.664223 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:18.664307 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.664313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.665734 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.665739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.667208 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.667214 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.668466 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.668471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.668589 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.668613 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.668685 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.668764 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260807 18:47:18.669152 30777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.662093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47592 (local address 127.10.174.194:37407)
0807 18:47:18.662605 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.662621 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.662901 (+ 280us) server_negotiation.cc:407] Connection header received
0807 18:47:18.663156 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.663163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.663411 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.663579 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:18.664115 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.665345 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.667111 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.667931 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.668051 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.668204 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.668903 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.669003 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":132,"threads_started":1}
I20260807 18:47:18.669447 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.662921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53824 (local address 127.10.174.193:41049)
0807 18:47:18.663748 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.663759 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.663782 (+ 23us) server_negotiation.cc:407] Connection header received
0807 18:47:18.663860 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.663867 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.664028 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.664215 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:18.664424 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.665554 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.667338 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.668097 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.668217 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.668385 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.669079 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.669183 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":138,"threads_started":1}
I20260807 18:47:18.671875 30698 tablet_service.cc:1467] Processing CreateTablet for tablet 22cb9c516c7048208fd2e6cc798e8252 (DEFAULT_TABLE table=test-table [id=68a3977c11e44188af2096f57f04a3ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:18.672013 30428 tablet_service.cc:1467] Processing CreateTablet for tablet 22cb9c516c7048208fd2e6cc798e8252 (DEFAULT_TABLE table=test-table [id=68a3977c11e44188af2096f57f04a3ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:18.672287 30563 tablet_service.cc:1467] Processing CreateTablet for tablet 22cb9c516c7048208fd2e6cc798e8252 (DEFAULT_TABLE table=test-table [id=68a3977c11e44188af2096f57f04a3ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:18.673071 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cb9c516c7048208fd2e6cc798e8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:18.673089 30698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cb9c516c7048208fd2e6cc798e8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:18.673110 30563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cb9c516c7048208fd2e6cc798e8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:18.680464 30782 tablet_bootstrap.cc:492] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: Bootstrap starting.
I20260807 18:47:18.681231 30784 tablet_bootstrap.cc:492] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Bootstrap starting.
I20260807 18:47:18.682996 30782 tablet_bootstrap.cc:654] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:18.683359 30784 tablet_bootstrap.cc:654] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:18.683666 30783 tablet_bootstrap.cc:492] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Bootstrap starting.
I20260807 18:47:18.684012 30782 log.cc:824] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:18.684100 30784 log.cc:824] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:18.685624 30783 tablet_bootstrap.cc:654] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:18.686287 30784 tablet_bootstrap.cc:492] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: No bootstrap required, opened a new log
I20260807 18:47:18.686287 30782 tablet_bootstrap.cc:492] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: No bootstrap required, opened a new log
I20260807 18:47:18.686308 30783 log.cc:824] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:18.686491 30784 ts_tablet_manager.cc:1397] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 18:47:18.686491 30782 ts_tablet_manager.cc:1397] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 18:47:18.688163 30783 tablet_bootstrap.cc:492] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: No bootstrap required, opened a new log
I20260807 18:47:18.688380 30783 ts_tablet_manager.cc:1397] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 18:47:18.691020 30782 raft_consensus.cc:348] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.691020 30784 raft_consensus.cc:348] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.691350 30782 raft_consensus.cc:374] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:18.691354 30784 raft_consensus.cc:374] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:18.691421 30784 raft_consensus.cc:729] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8ec62f203049e984aaf39c48b0b132, State: Initialized, Role: FOLLOWER
I20260807 18:47:18.691445 30782 raft_consensus.cc:729] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba46a9c11cc649ff8742235afe399c08, State: Initialized, Role: FOLLOWER
I20260807 18:47:18.691942 30782 consensus_queue.cc:260] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.691942 30784 consensus_queue.cc:260] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.692142 30783 raft_consensus.cc:348] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.692456 30783 raft_consensus.cc:374] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:18.692549 30783 raft_consensus.cc:729] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d6fa91cd3044759bab91a84e774d4f, State: Initialized, Role: FOLLOWER
I20260807 18:47:18.692952 30497 heartbeater.cc:503] Master 127.10.174.254:36391 was elected leader, sending a full tablet report...
I20260807 18:47:18.692953 30631 heartbeater.cc:503] Master 127.10.174.254:36391 was elected leader, sending a full tablet report...
I20260807 18:47:18.693058 30784 ts_tablet_manager.cc:1428] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260807 18:47:18.693068 30782 ts_tablet_manager.cc:1428] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 18:47:18.693550 30783 consensus_queue.cc:260] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.694512 30765 heartbeater.cc:503] Master 127.10.174.254:36391 was elected leader, sending a full tablet report...
I20260807 18:47:18.694528 30783 ts_tablet_manager.cc:1428] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 18:47:18.698378 30498 tablet.cc:2369] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:18.803644 30790 raft_consensus.cc:482] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:18.803892 30790 raft_consensus.cc:504] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.805088 30790 leader_election.cc:288] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8ec62f203049e984aaf39c48b0b132 (127.10.174.194:37407), ba46a9c11cc649ff8742235afe399c08 (127.10.174.193:41049)
I20260807 18:47:18.809229 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.805424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:37407 (local address 127.10.174.195:45795)
0807 18:47:18.805586 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.805605 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.805719 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.806072 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.806076 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.806100 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:18.806243 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.806252 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.807147 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.807151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.808058 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.808067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.808769 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.808773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.808884 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.808910 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.808987 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.809055 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 18:47:18.809231 30777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.805509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:45795 (local address 127.10.174.194:37407)
0807 18:47:18.805684 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.805689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.805705 (+ 16us) server_negotiation.cc:407] Connection header received
0807 18:47:18.805835 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.805839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.805888 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.805974 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:18.806373 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.807033 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.808193 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.808649 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.808746 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.808784 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.809018 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.809109 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 18:47:18.809305 30792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.805750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:41049 (local address 127.10.174.195:37275)
0807 18:47:18.806142 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.806154 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:18.806233 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:18.806463 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:18.806466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:18.806482 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:18.806605 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.806610 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.807427 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.807429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.808224 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:18.808234 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.808888 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.808891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:18.808990 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.809014 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:47:18.809097 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 18:47:18.809159 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":1,"thread_start_us":146,"threads_started":1}
I20260807 18:47:18.809325 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.805909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:37275 (local address 127.10.174.193:41049)
0807 18:47:18.806044 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.806048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.806234 (+ 186us) server_negotiation.cc:407] Connection header received
0807 18:47:18.806300 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.806304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.806365 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.806431 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:18.806735 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.807281 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.808347 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.808767 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.808886 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.808929 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.809127 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.809194 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:47:18.809928 30449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cb9c516c7048208fd2e6cc798e8252" candidate_uuid: "b6d6fa91cd3044759bab91a84e774d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba46a9c11cc649ff8742235afe399c08" is_pre_election: true
I20260807 18:47:18.809964 30584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cb9c516c7048208fd2e6cc798e8252" candidate_uuid: "b6d6fa91cd3044759bab91a84e774d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ec62f203049e984aaf39c48b0b132" is_pre_election: true
I20260807 18:47:18.810250 30449 raft_consensus.cc:2454] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d6fa91cd3044759bab91a84e774d4f in term 0.
I20260807 18:47:18.810252 30584 raft_consensus.cc:2454] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d6fa91cd3044759bab91a84e774d4f in term 0.
I20260807 18:47:18.810745 30649 leader_election.cc:302] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d6fa91cd3044759bab91a84e774d4f, ba46a9c11cc649ff8742235afe399c08; no voters:
I20260807 18:47:18.811040 30790 raft_consensus.cc:2781] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:18.811128 30790 raft_consensus.cc:482] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:18.811159 30790 raft_consensus.cc:3037] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:18.812245 30790 raft_consensus.cc:504] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.812592 30790 leader_election.cc:288] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [CANDIDATE]: Term 1 election: Requested vote from peers 6d8ec62f203049e984aaf39c48b0b132 (127.10.174.194:37407), ba46a9c11cc649ff8742235afe399c08 (127.10.174.193:41049)
I20260807 18:47:18.812989 30584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cb9c516c7048208fd2e6cc798e8252" candidate_uuid: "b6d6fa91cd3044759bab91a84e774d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8ec62f203049e984aaf39c48b0b132"
I20260807 18:47:18.813104 30584 raft_consensus.cc:3037] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:18.813123 30449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cb9c516c7048208fd2e6cc798e8252" candidate_uuid: "b6d6fa91cd3044759bab91a84e774d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba46a9c11cc649ff8742235afe399c08"
I20260807 18:47:18.813264 30449 raft_consensus.cc:3037] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:18.814184 30584 raft_consensus.cc:2454] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d6fa91cd3044759bab91a84e774d4f in term 1.
I20260807 18:47:18.814429 30449 raft_consensus.cc:2454] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d6fa91cd3044759bab91a84e774d4f in term 1.
I20260807 18:47:18.814517 30649 leader_election.cc:302] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8ec62f203049e984aaf39c48b0b132, b6d6fa91cd3044759bab91a84e774d4f; no voters:
I20260807 18:47:18.814718 30790 raft_consensus.cc:2781] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:18.814941 30790 raft_consensus.cc:686] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 1 LEADER]: Becoming Leader. State: Replica: b6d6fa91cd3044759bab91a84e774d4f, State: Running, Role: LEADER
I20260807 18:47:18.815338 30790 consensus_queue.cc:237] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } }
I20260807 18:47:18.818514 30301 catalog_manager.cc:5495] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to b6d6fa91cd3044759bab91a84e774d4f (127.10.174.195). New cstate: current_term: 1 leader_uuid: "b6d6fa91cd3044759bab91a84e774d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d6fa91cd3044759bab91a84e774d4f" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 32829 } health_report { overall_health: HEALTHY } } }
I20260807 18:47:18.865574 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:18.861952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33954 (local address 127.10.174.195:32829)
0807 18:47:18.862111 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:18.862116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:18.862135 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:47:18.862205 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:18.862207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:18.862261 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:18.862371 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:18.862619 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.863168 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.864072 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:18.864288 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:18.864389 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:18.864735 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:18.865127 (+ 392us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:18.865287 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:18.865377 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 18:47:18.865411 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:47:18.871537 30449 raft_consensus.cc:1261] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 1 FOLLOWER]: Refusing update from remote peer b6d6fa91cd3044759bab91a84e774d4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:18.871528 30584 raft_consensus.cc:1261] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 1 FOLLOWER]: Refusing update from remote peer b6d6fa91cd3044759bab91a84e774d4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 18:47:18.872104 30766 tablet.cc:2369] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:18.872289 30790 consensus_queue.cc:1035] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba46a9c11cc649ff8742235afe399c08" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 41049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:18.872517 30793 consensus_queue.cc:1035] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8ec62f203049e984aaf39c48b0b132" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 37407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:18.880002 30796 mvcc.cc:205] Tried to move back new op lower bound from 7315982085610008576 to 7315982085390540800. Current Snapshot: MvccSnapshot[applied={T|T < 7315982085610008576}]
I20260807 18:47:18.881117 30797 mvcc.cc:205] Tried to move back new op lower bound from 7315982085610008576 to 7315982085390540800. Current Snapshot: MvccSnapshot[applied={T|T < 7315982085610008576}]
I20260807 18:47:18.888244 30300 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:18.888433 30300 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:18.891038 30300 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 76d44f17119b47c09e0661f94ad8fdc7: Sending DeleteTablet for 3 replicas of tablet 22cb9c516c7048208fd2e6cc798e8252
I20260807 18:47:18.891927 30563 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cb9c516c7048208fd2e6cc798e8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:18 UTC) from {username='slave'} at 127.0.0.1:47592
I20260807 18:47:18.891968 30698 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cb9c516c7048208fd2e6cc798e8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:18 UTC) from {username='slave'} at 127.0.0.1:33940
I20260807 18:47:18.892467 30806 tablet_replica.cc:330] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: stopping tablet replica
I20260807 18:47:18.892467 30428 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cb9c516c7048208fd2e6cc798e8252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:18 UTC) from {username='slave'} at 127.0.0.1:53824
I20260807 18:47:18.892812 30807 tablet_replica.cc:330] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: stopping tablet replica
I20260807 18:47:18.892917 30808 tablet_replica.cc:330] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08: stopping tablet replica
I20260807 18:47:18.893216 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30364
I20260807 18:47:18.893242 30808 raft_consensus.cc:2229] T 22cb9c516c7048208fd2e6cc798e8252 P ba46a9c11cc649ff8742235afe399c08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:18.896543 30807 raft_consensus.cc:2229] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:47:18.896652 30806 raft_consensus.cc:2229] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:18.897006 30806 raft_consensus.cc:2258] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:18.897162 30807 raft_consensus.cc:2258] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:18.898566 30806 ts_tablet_manager.cc:1905] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:18.898854 30807 ts_tablet_manager.cc:1905] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:18.901342 30806 ts_tablet_manager.cc:1918] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:18.901444 30806 log.cc:1196] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/22cb9c516c7048208fd2e6cc798e8252
I20260807 18:47:18.901757 30806 ts_tablet_manager.cc:1939] T 22cb9c516c7048208fd2e6cc798e8252 P 6d8ec62f203049e984aaf39c48b0b132: Deleting consensus metadata
I20260807 18:47:18.902551 30807 ts_tablet_manager.cc:1918] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:18.902738 30807 log.cc:1196] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/22cb9c516c7048208fd2e6cc798e8252
W20260807 18:47:18.902941 30286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:41049 (error 108)
I20260807 18:47:18.903143 30807 ts_tablet_manager.cc:1939] T 22cb9c516c7048208fd2e6cc798e8252 P b6d6fa91cd3044759bab91a84e774d4f: Deleting consensus metadata
I20260807 18:47:18.903522 30286 catalog_manager.cc:4841] TS 6d8ec62f203049e984aaf39c48b0b132 (127.10.174.194:37407): tablet 22cb9c516c7048208fd2e6cc798e8252 (table test-table [id=68a3977c11e44188af2096f57f04a3ea]) successfully deleted
W20260807 18:47:18.904177 30780 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:18.903864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:41049 (local address 127.0.0.1:53838)
0807 18:47:18.904009 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:18.904084 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:41049: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 18:47:18.904265 30287 catalog_manager.cc:4841] TS b6d6fa91cd3044759bab91a84e774d4f (127.10.174.195:32829): tablet 22cb9c516c7048208fd2e6cc798e8252 (table test-table [id=68a3977c11e44188af2096f57f04a3ea]) successfully deleted
W20260807 18:47:18.904312 30286 catalog_manager.cc:4584] TS ba46a9c11cc649ff8742235afe399c08 (127.10.174.193:41049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 22cb9c516c7048208fd2e6cc798e8252: Network error: Client connection negotiation failed: client connection to 127.10.174.193:41049: connect: Connection reset by peer (error 104)
I20260807 18:47:18.904660 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30500
I20260807 18:47:18.912379 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30634
I20260807 18:47:18.918586 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30271
2026-08-07T18:47:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1166 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:18 dist-test-slave-07c2 krb5kdc[30812](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:18 dist-test-slave-07c2 krb5kdc[30812](info): set up 2 sockets
Aug 07 18:47:18 dist-test-slave-07c2 krb5kdc[30812](info): commencing operation
krb5kdc: starting...
W20260807 18:47:19.970146 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:20.094300 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36561
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:36561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:20.205442 30825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:20.205775 30825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:20.205857 30825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:20.209964 30825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:20.210052 30825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:20.210091 30825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:20.210144 30825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:20.210183 30825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:20.215476 30825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:36561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:36561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:20.216560 30825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:20.217581 30825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:20.226101 30831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.226112 30833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.226125 30830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:20.226150 30825 server_base.cc:1034] running on GCE node
I20260807 18:47:20.226959 30825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:20.228093 30825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:20.229283 30825 hybrid_clock.cc:648] HybridClock initialized: now 1786128440229264 us; error 32 us; skew 500 ppm
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:20.232054 30825 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:20.232947 30825 webserver.cc:460] Webserver started at http://127.10.174.254:43217/ using document root <none> and password file <none>
I20260807 18:47:20.233496 30825 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:20.233584 30825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:20.233814 30825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:20.235893 30825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "d839853083f6423ab0c1006a7be98dc6"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "6e4da12f49562d290d4cc79950ce5d16"
server_key_iv: "c85f283bddcf82d952570108cc7f6146"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.236455 30825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "d839853083f6423ab0c1006a7be98dc6"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "6e4da12f49562d290d4cc79950ce5d16"
server_key_iv: "c85f283bddcf82d952570108cc7f6146"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.240192 30825 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:47:20.242496 30840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.243719 30825 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:47:20.243848 30825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "d839853083f6423ab0c1006a7be98dc6"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "6e4da12f49562d290d4cc79950ce5d16"
server_key_iv: "c85f283bddcf82d952570108cc7f6146"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.243964 30825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:20.256942 30825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:20.260130 30825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:20.260366 30825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:20.267597 30825 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:36561
I20260807 18:47:20.267627 30894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:36561 every 8 connection(s)
I20260807 18:47:20.268589 30825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:20.271153 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30825
I20260807 18:47:20.271288 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:20.271270 30895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:20.271589 10939 external_mini_cluster.cc:1428] Setting key 44678b05637c07032766edb37ae4773c
I20260807 18:47:20.278050 30895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6: Bootstrap starting.
I20260807 18:47:20.280380 30895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:20.281195 30895 log.cc:824] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:20.283723 30895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6: No bootstrap required, opened a new log
I20260807 18:47:20.287772 30898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.273396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59024 (local address 127.10.174.254:36561)
0807 18:47:20.273925 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:20.273942 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:20.273981 (+ 39us) server_negotiation.cc:407] Connection header received
0807 18:47:20.274731 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:20.274749 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:20.275094 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:20.275533 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:20.276455 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.277546 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.278606 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.279114 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.279301 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:20.282256 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:20.282263 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:20.282279 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:20.282308 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:20.284425 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:20.284905 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:20.284910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:20.284917 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:20.285049 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:20.285360 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:20.285364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:20.285365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:20.285895 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:20.286129 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:20.286368 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 18:47:20.286682 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":175,"threads_started":1}
I20260807 18:47:20.288612 30895 raft_consensus.cc:348] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d839853083f6423ab0c1006a7be98dc6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36561 } }
I20260807 18:47:20.288863 30895 raft_consensus.cc:374] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:20.288949 30895 raft_consensus.cc:729] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d839853083f6423ab0c1006a7be98dc6, State: Initialized, Role: FOLLOWER
I20260807 18:47:20.289356 30895 consensus_queue.cc:260] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d839853083f6423ab0c1006a7be98dc6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36561 } }
I20260807 18:47:20.289481 30895 raft_consensus.cc:388] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:20.289563 30895 raft_consensus.cc:482] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:20.289677 30895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:20.290736 30895 raft_consensus.cc:504] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d839853083f6423ab0c1006a7be98dc6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36561 } }
I20260807 18:47:20.291077 30895 leader_election.cc:302] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d839853083f6423ab0c1006a7be98dc6; no voters:
I20260807 18:47:20.291540 30895 leader_election.cc:288] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:20.291653 30900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:20.291921 30900 raft_consensus.cc:686] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [term 1 LEADER]: Becoming Leader. State: Replica: d839853083f6423ab0c1006a7be98dc6, State: Running, Role: LEADER
I20260807 18:47:20.292271 30900 consensus_queue.cc:237] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d839853083f6423ab0c1006a7be98dc6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36561 } }
I20260807 18:47:20.292912 30895 sys_catalog.cc:564] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:20.293974 30901 sys_catalog.cc:455] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d839853083f6423ab0c1006a7be98dc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d839853083f6423ab0c1006a7be98dc6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36561 } } }
I20260807 18:47:20.294112 30901 sys_catalog.cc:458] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:20.294515 30909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:20.294502 30902 sys_catalog.cc:455] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d839853083f6423ab0c1006a7be98dc6. Latest consensus state: current_term: 1 leader_uuid: "d839853083f6423ab0c1006a7be98dc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d839853083f6423ab0c1006a7be98dc6" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 36561 } } }
I20260807 18:47:20.294911 30902 sys_catalog.cc:458] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:20.297349 30909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:20.302452 30909 catalog_manager.cc:1347] Generated new cluster ID: 06096edadf2c4c7db67c858aeec36fd1
I20260807 18:47:20.302524 30909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:20.313285 30909 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:20.314188 30909 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:20.323702 30909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6: Generated new TSK 0
I20260807 18:47:20.324373 30909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
Entry for principal kudu/127.10.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab.
I20260807 18:47:20.356472 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36561
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:20.467563 30921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:20.467818 30921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:20.467864 30921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:20.472028 30921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:20.472086 30921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:20.472143 30921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:47:20.477402 30921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.193.keytab
--principal=kudu/127.10.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:20.478374 30921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:20.479405 30921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:20.488725 30927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.488755 30926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.488755 30929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:20.489172 30921 server_base.cc:1034] running on GCE node
I20260807 18:47:20.489573 30921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:20.490191 30921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:20.491364 30921 hybrid_clock.cc:648] HybridClock initialized: now 1786128440491351 us; error 33 us; skew 500 ppm
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:20.494112 30921 init.cc:377] Logged in from keytab as kudu/127.10.174.193@KRBTEST.COM (short username kudu)
I20260807 18:47:20.495013 30921 webserver.cc:460] Webserver started at http://127.10.174.193:35997/ using document root <none> and password file <none>
I20260807 18:47:20.495639 30921 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:20.495728 30921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:20.495932 30921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:20.497885 30921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "b7a45538a8ae4e068aa341b9bf08e3c1"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "a0048c0af424ac77d8d9d17962d8170b"
server_key_iv: "768c862ab2d471a86b99a6e59698bf51"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.498438 30921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "b7a45538a8ae4e068aa341b9bf08e3c1"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "a0048c0af424ac77d8d9d17962d8170b"
server_key_iv: "768c862ab2d471a86b99a6e59698bf51"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.501986 30921 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:47:20.504235 30936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.505637 30921 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:20.505781 30921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "b7a45538a8ae4e068aa341b9bf08e3c1"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "a0048c0af424ac77d8d9d17962d8170b"
server_key_iv: "768c862ab2d471a86b99a6e59698bf51"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.505892 30921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:20.533455 30921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:20.536922 30921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:20.537137 30921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:20.537761 30921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:20.538609 30921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:20.538681 30921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.538751 30921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:20.538790 30921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.547601 30921 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:43703
I20260807 18:47:20.547623 31053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:43703 every 8 connection(s)
I20260807 18:47:20.548609 30921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:47:20.553697 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 30921
I20260807 18:47:20.553853 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:47:20.554203 10939 external_mini_cluster.cc:1428] Setting key 8a2ea620de0e865df2f3fb5348f23d21
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.193@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:20.563879 30898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.550693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:41053 (local address 127.10.174.254:36561)
0807 18:47:20.550884 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:20.550889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:20.551793 (+ 904us) server_negotiation.cc:407] Connection header received
0807 18:47:20.553099 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:20.553102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:20.553150 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:20.553227 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:20.554459 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.555154 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.556501 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.556934 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.557065 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:20.559984 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:20.559987 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:20.559989 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:20.560013 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:20.561538 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:20.562205 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:20.562208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:20.562209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:20.562284 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:20.562686 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:20.562688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:20.562689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:20.562873 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:20.562947 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:20.563624 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 18:47:20.563740 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 18:47:20.565085 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.551132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36561 (local address 127.10.174.193:41053)
0807 18:47:20.551639 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:20.551684 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:20.552910 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:20.553358 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:20.553364 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:20.553710 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:20.554273 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:20.554305 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.555323 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.555327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:20.556366 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:20.556376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.557082 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.557084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:20.557222 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:20.557855 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:20.557883 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:20.559795 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:20.561665 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:20.561673 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:20.561691 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:20.562096 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:20.562374 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:20.562380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:20.562384 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:20.562583 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:20.562979 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:20.562988 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:20.563357 (+ 369us) client_negotiation.cc:769] Sending connection context
0807 18:47:20.563579 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 18:47:20.563945 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":178,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.194@KRBTEST.COM; defaulting to no policy
I20260807 18:47:20.566334 31054 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36561
I20260807 18:47:20.566601 31054 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:20.567129 31054 heartbeater.cc:511] Master 127.10.174.254:36561 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.194@KRBTEST.COM" created.
I20260807 18:47:20.568857 30857 ts_manager.cc:194] Registered new tserver with Master: b7a45538a8ae4e068aa341b9bf08e3c1 (127.10.174.193:43703)
I20260807 18:47:20.570308 30857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.193@KRBTEST.COM'} at 127.10.174.193:41053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
Entry for principal kudu/127.10.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab.
I20260807 18:47:20.584074 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36561
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:20.694784 31060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:20.695040 31060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:20.695084 31060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:20.699131 31060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:20.699201 31060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:20.699262 31060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:47:20.704650 31060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.194.keytab
--principal=kudu/127.10.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:20.705674 31060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:20.706658 31060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:20.716461 31066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:20.716516 31060 server_base.cc:1034] running on GCE node
W20260807 18:47:20.716466 31065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.716461 31068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:20.717283 31060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:20.717968 31060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:20.719149 31060 hybrid_clock.cc:648] HybridClock initialized: now 1786128440719122 us; error 48 us; skew 500 ppm
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:20.721913 31060 init.cc:377] Logged in from keytab as kudu/127.10.174.194@KRBTEST.COM (short username kudu)
I20260807 18:47:20.722750 31060 webserver.cc:460] Webserver started at http://127.10.174.194:46063/ using document root <none> and password file <none>
I20260807 18:47:20.723330 31060 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:20.723403 31060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:20.723580 31060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:20.725610 31060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "2317cc0aac7048da9851a0e992c7412b"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "9c49539084e0d98a340b05fcd17c1f94"
server_key_iv: "4c8430df2b1dad5c28c6011a5793981e"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.726130 31060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "2317cc0aac7048da9851a0e992c7412b"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "9c49539084e0d98a340b05fcd17c1f94"
server_key_iv: "4c8430df2b1dad5c28c6011a5793981e"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.730016 31060 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 18:47:20.732539 31075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.733799 31060 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:20.733927 31060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "2317cc0aac7048da9851a0e992c7412b"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "9c49539084e0d98a340b05fcd17c1f94"
server_key_iv: "4c8430df2b1dad5c28c6011a5793981e"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.734054 31060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:20.749908 31060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:20.753172 31060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:20.753417 31060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:20.754050 31060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:20.754930 31060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:20.754977 31060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.755039 31060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:20.755076 31060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.764587 31060 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:39367
I20260807 18:47:20.764606 31192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:39367 every 8 connection(s)
I20260807 18:47:20.765561 31060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:47:20.771075 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31060
I20260807 18:47:20.771248 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:47:20.771569 10939 external_mini_cluster.cc:1428] Setting key b66379baaecaf3a01e212fd6fb5635be
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.194@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:20.780632 30898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.767430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:51973 (local address 127.10.174.254:36561)
0807 18:47:20.767575 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:20.767579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:20.768412 (+ 833us) server_negotiation.cc:407] Connection header received
0807 18:47:20.769843 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:20.769846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:20.769910 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:20.770014 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:20.771281 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.771922 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.773315 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.773547 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.773650 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:20.776435 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:20.776441 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:20.776447 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:20.776484 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:20.778289 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:20.778814 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:20.778821 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:20.778826 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:20.778927 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:20.779260 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:20.779265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:20.779268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:20.779599 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:20.779728 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:20.780264 (+ 536us) server_negotiation.cc:299] Negotiation successful
0807 18:47:20.780417 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:47:20.781401 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.767808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36561 (local address 127.10.174.194:51973)
0807 18:47:20.768258 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:20.768307 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:20.769611 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:20.770205 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:20.770212 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:20.770582 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:20.771118 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:20.771132 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.772054 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.772058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:20.773189 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:20.773200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.773706 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.773711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:20.773893 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:20.774522 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:20.774539 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:20.776236 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:20.778415 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:20.778420 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:20.778434 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:20.778705 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:20.779027 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:20.779029 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:20.779030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:20.779166 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:20.779710 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:20.779715 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:20.779986 (+ 271us) client_negotiation.cc:769] Sending connection context
0807 18:47:20.780154 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 18:47:20.780436 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for kudu/127.10.174.195@KRBTEST.COM; defaulting to no policy
I20260807 18:47:20.782680 31193 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36561
I20260807 18:47:20.782964 31193 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:20.783565 31193 heartbeater.cc:511] Master 127.10.174.254:36561 requested a full tablet report, sending...
I20260807 18:47:20.784698 30857 ts_manager.cc:194] Registered new tserver with Master: 2317cc0aac7048da9851a0e992c7412b (127.10.174.194:39367)
I20260807 18:47:20.785363 30857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.194@KRBTEST.COM'} at 127.10.174.194:51973
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
Entry for principal kudu/127.10.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab.
I20260807 18:47:20.800453 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36561
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:20.912356 31198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:20.912742 31198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:20.912808 31198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:20.916901 31198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:20.916953 31198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:20.917011 31198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:47:20.922236 31198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.195.keytab
--principal=kudu/127.10.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:36561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:20.923256 31198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:20.924291 31198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:20.934125 31203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.934142 31204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:20.934135 31206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:20.934305 31198 server_base.cc:1034] running on GCE node
I20260807 18:47:20.934921 31198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:20.935746 31198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:20.936924 31198 hybrid_clock.cc:648] HybridClock initialized: now 1786128440936890 us; error 46 us; skew 500 ppm
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:20.939788 31198 init.cc:377] Logged in from keytab as kudu/127.10.174.195@KRBTEST.COM (short username kudu)
I20260807 18:47:20.940711 31198 webserver.cc:460] Webserver started at http://127.10.174.195:33883/ using document root <none> and password file <none>
I20260807 18:47:20.941295 31198 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:20.941358 31198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:20.941602 31198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:20.943774 31198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "90a88fb8ad464578b521d89abd86a543"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "1950c823a9e2d32d14ebe7d7b339ee5b"
server_key_iv: "c3a3d200f357eddaa43e37294dd4eb04"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.944357 31198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "90a88fb8ad464578b521d89abd86a543"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "1950c823a9e2d32d14ebe7d7b339ee5b"
server_key_iv: "c3a3d200f357eddaa43e37294dd4eb04"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.948177 31198 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 18:47:20.950603 31213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.951871 31198 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:20.951994 31198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "90a88fb8ad464578b521d89abd86a543"
format_stamp: "Formatted at 2026-08-07 18:47:20 on dist-test-slave-07c2"
server_key: "1950c823a9e2d32d14ebe7d7b339ee5b"
server_key_iv: "c3a3d200f357eddaa43e37294dd4eb04"
server_key_version: "encryptionkey@0"
I20260807 18:47:20.952100 31198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:20.976388 31198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:20.979372 31198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:20.979581 31198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:20.980197 31198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:20.981042 31198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:20.981091 31198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.981155 31198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:20.981191 31198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:20.990216 31198 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:36239
I20260807 18:47:20.990238 31333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:36239 every 8 connection(s)
I20260807 18:47:20.991190 31198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:47:20.997859 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31198
I20260807 18:47:20.998031 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:47:20.998351 10939 external_mini_cluster.cc:1428] Setting key 337ae20983c8f9073ec1cdfd9913c471
Aug 07 18:47:20 dist-test-slave-07c2 krb5kdc[30812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.195@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:21.005560 30898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.993162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:44055 (local address 127.10.174.254:36561)
0807 18:47:20.993334 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:20.993375 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:20.994256 (+ 881us) server_negotiation.cc:407] Connection header received
0807 18:47:20.995815 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:20.995818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:20.995879 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:20.995983 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:20.997164 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.997801 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.999276 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.999604 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.999732 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.002325 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:21.002328 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:21.002330 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:21.002354 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:21.003825 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:21.004287 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:21.004290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:21.004291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:21.004368 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:21.004645 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:21.004647 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:21.004648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:21.004832 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:21.004907 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.005338 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.005437 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 18:47:21.006414 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:20.993614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:36561 (local address 127.10.174.195:44055)
0807 18:47:20.994090 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:20.994138 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:20.995598 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:20.996159 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:20.996166 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:20.996531 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:20.997018 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:20.997032 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.997958 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.997961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:20.999134 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:20.999148 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:20.999802 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:20.999807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:20.999995 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.000703 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:21.000720 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:21.002176 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:21.003932 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:21.003937 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:21.003947 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:21.004195 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:21.004441 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:21.004443 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:21.004445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:21.004572 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:21.004914 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:21.004919 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:21.005145 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.005296 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.005546 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":135,"threads_started":1}
I20260807 18:47:21.007612 31334 heartbeater.cc:347] Connected to a master server at 127.10.174.254:36561
I20260807 18:47:21.007856 31334 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:21.008354 31334 heartbeater.cc:511] Master 127.10.174.254:36561 requested a full tablet report, sending...
I20260807 18:47:21.009385 30857 ts_manager.cc:194] Registered new tserver with Master: 90a88fb8ad464578b521d89abd86a543 (127.10.174.195:36239)
I20260807 18:47:21.009985 30857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.174.195@KRBTEST.COM'} at 127.10.174.195:44055
I20260807 18:47:21.012444 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:47:21.021517 30898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.014545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59038 (local address 127.10.174.254:36561)
0807 18:47:21.014662 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.014666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.014878 (+ 212us) server_negotiation.cc:407] Connection header received
0807 18:47:21.014971 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.014973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.015012 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.015078 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:21.015823 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.016372 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.017149 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.017356 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.017430 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.018667 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:21.018670 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:21.018672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:21.018695 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:21.020195 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:21.020537 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:21.020540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:21.020541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:21.020615 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:21.020837 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:21.020840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:21.020841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:21.021043 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:21.021142 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.021303 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.021398 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:47:21.024362 30857 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:47:21.027504 30857 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:47:21.042356 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.036400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49746 (local address 127.10.174.195:36239)
0807 18:47:21.037155 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.037167 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.037186 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:47:21.037249 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.037253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.037443 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.037601 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:21.037950 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.039274 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.040729 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.041598 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.041734 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.041842 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.042069 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.042177 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":152,"threads_started":1}
I20260807 18:47:21.042348 31349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.035707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:36239 (local address 127.0.0.1:49746)
0807 18:47:21.036794 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.036806 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.036903 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.037621 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.037626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.037648 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:21.037808 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.037817 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.039522 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.039526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.040588 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.040598 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.041734 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.041738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.041853 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.041900 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.042021 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.042156 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1020,"mutex_wait_us":25,"thread_start_us":138,"threads_started":1}
I20260807 18:47:21.042857 31347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.036494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:39367 (local address 127.0.0.1:34886)
0807 18:47:21.037042 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.037053 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.037122 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.037786 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.037789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.037818 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:21.038013 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.038020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.040340 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.040344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.041239 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.041248 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.042459 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.042463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.042554 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.042578 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.042645 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.042713 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":68,"spinlock_wait_cycles":1920,"thread_start_us":90,"threads_started":1}
I20260807 18:47:21.043358 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.036732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34886 (local address 127.10.174.194:39367)
0807 18:47:21.037083 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.037095 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.037120 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:47:21.037231 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.037236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.037443 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.037601 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:21.039468 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.040192 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.041380 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.042161 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.042277 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.042392 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.043091 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.043197 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":105,"threads_started":1}
I20260807 18:47:21.044370 31345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.035593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:43703 (local address 127.0.0.1:32896)
0807 18:47:21.036174 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.036224 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.036363 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.037793 (+ 1430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.037795 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.037822 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:21.038020 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.038026 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.040386 (+ 2360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.040389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.041586 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.041596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.044012 (+ 2416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.044016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.044117 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.044146 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.044200 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.044270 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":64,"spinlock_wait_cycles":7296,"thread_start_us":94,"threads_started":1}
I20260807 18:47:21.044895 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.035720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32896 (local address 127.10.174.193:43703)
0807 18:47:21.037323 (+ 1603us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.037357 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.037382 (+ 25us) server_negotiation.cc:407] Connection header received
0807 18:47:21.037454 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.037458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.037677 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.037822 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:21.038115 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.039317 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.042954 (+ 3637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.043861 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.044581 (+ 720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.044679 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.044717 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.044787 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1509,"thread_start_us":107,"threads_started":1}
I20260807 18:47:21.045521 31264 tablet_service.cc:1467] Processing CreateTablet for tablet 8c379c22af554043a20982bcf721d17b (DEFAULT_TABLE table=test-table [id=6037ebd6d013417da74690e160f4d154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:21.045936 31125 tablet_service.cc:1467] Processing CreateTablet for tablet 8c379c22af554043a20982bcf721d17b (DEFAULT_TABLE table=test-table [id=6037ebd6d013417da74690e160f4d154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:21.046762 31264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c379c22af554043a20982bcf721d17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:21.046897 31125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c379c22af554043a20982bcf721d17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:21.053783 30986 tablet_service.cc:1467] Processing CreateTablet for tablet 8c379c22af554043a20982bcf721d17b (DEFAULT_TABLE table=test-table [id=6037ebd6d013417da74690e160f4d154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:21.054670 31351 tablet_bootstrap.cc:492] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Bootstrap starting.
I20260807 18:47:21.054893 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c379c22af554043a20982bcf721d17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:21.055169 31352 tablet_bootstrap.cc:492] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Bootstrap starting.
I20260807 18:47:21.057636 31352 tablet_bootstrap.cc:654] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:21.059080 31352 log.cc:824] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:21.061201 31351 tablet_bootstrap.cc:654] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:21.061368 31352 tablet_bootstrap.cc:492] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: No bootstrap required, opened a new log
I20260807 18:47:21.061568 31352 ts_tablet_manager.cc:1397] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:47:21.062400 31351 log.cc:824] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:21.062700 31354 tablet_bootstrap.cc:492] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: Bootstrap starting.
I20260807 18:47:21.064741 31351 tablet_bootstrap.cc:492] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: No bootstrap required, opened a new log
I20260807 18:47:21.064949 31351 ts_tablet_manager.cc:1397] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260807 18:47:21.065042 31354 tablet_bootstrap.cc:654] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:21.065524 31352 raft_consensus.cc:348] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.065773 31352 raft_consensus.cc:374] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:21.065835 31352 raft_consensus.cc:729] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2317cc0aac7048da9851a0e992c7412b, State: Initialized, Role: FOLLOWER
I20260807 18:47:21.066270 31352 consensus_queue.cc:260] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.066505 31354 log.cc:824] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:21.067018 31193 heartbeater.cc:503] Master 127.10.174.254:36561 was elected leader, sending a full tablet report...
I20260807 18:47:21.067396 31352 ts_tablet_manager.cc:1428] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 18:47:21.068858 31351 raft_consensus.cc:348] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.069092 31351 raft_consensus.cc:374] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:21.069144 31351 raft_consensus.cc:729] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90a88fb8ad464578b521d89abd86a543, State: Initialized, Role: FOLLOWER
I20260807 18:47:21.069242 31354 tablet_bootstrap.cc:492] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: No bootstrap required, opened a new log
I20260807 18:47:21.069453 31354 ts_tablet_manager.cc:1397] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 18:47:21.069608 31351 consensus_queue.cc:260] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.070232 31334 heartbeater.cc:503] Master 127.10.174.254:36561 was elected leader, sending a full tablet report...
I20260807 18:47:21.071815 31351 ts_tablet_manager.cc:1428] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 18:47:21.073233 31354 raft_consensus.cc:348] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.073482 31354 raft_consensus.cc:374] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:21.073547 31354 raft_consensus.cc:729] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7a45538a8ae4e068aa341b9bf08e3c1, State: Initialized, Role: FOLLOWER
I20260807 18:47:21.074015 31354 consensus_queue.cc:260] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.074640 31054 heartbeater.cc:503] Master 127.10.174.254:36561 was elected leader, sending a full tablet report...
I20260807 18:47:21.074939 31354 ts_tablet_manager.cc:1428] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 18:47:21.117527 31359 raft_consensus.cc:482] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:21.117726 31359 raft_consensus.cc:504] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.118848 31359 leader_election.cc:288] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90a88fb8ad464578b521d89abd86a543 (127.10.174.195:36239), 2317cc0aac7048da9851a0e992c7412b (127.10.174.194:39367)
I20260807 18:47:21.122866 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.119208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:42245 (local address 127.10.174.194:39367)
0807 18:47:21.119392 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.119399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.119604 (+ 205us) server_negotiation.cc:407] Connection header received
0807 18:47:21.119789 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.119793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.119847 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.119934 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:21.120233 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.120724 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.121839 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.122236 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.122369 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.122423 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.122658 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.122733 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 18:47:21.122865 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.119184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:35769 (local address 127.10.174.195:36239)
0807 18:47:21.119410 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.119415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.119597 (+ 182us) server_negotiation.cc:407] Connection header received
0807 18:47:21.119788 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.119792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.119842 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.119923 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:21.120219 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.120709 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.121833 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.122222 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.122360 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.122423 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.122650 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.122727 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260807 18:47:21.122925 31360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.119074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:36239 (local address 127.10.174.193:35769)
0807 18:47:21.119501 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.119513 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.119676 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.119933 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.119936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.119951 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:21.120115 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.120120 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.120819 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.120824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.121702 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.121712 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.122360 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.122364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.122520 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.122539 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.122620 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.122727 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":79,"spinlock_wait_cycles":47616,"thread_start_us":124,"threads_started":1}
I20260807 18:47:21.122929 31361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.119104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:39367 (local address 127.10.174.193:42245)
0807 18:47:21.119513 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.119524 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.119677 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.119944 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.119947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.119964 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:21.120123 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.120128 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.120844 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.120848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.121718 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.121727 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.122361 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.122365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.122504 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.122544 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.122626 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.122733 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":96,"spinlock_wait_cycles":10880,"thread_start_us":124,"threads_started":1}
I20260807 18:47:21.123618 31284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c379c22af554043a20982bcf721d17b" candidate_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90a88fb8ad464578b521d89abd86a543" is_pre_election: true
I20260807 18:47:21.123713 31145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c379c22af554043a20982bcf721d17b" candidate_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2317cc0aac7048da9851a0e992c7412b" is_pre_election: true
I20260807 18:47:21.123960 31284 raft_consensus.cc:2454] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7a45538a8ae4e068aa341b9bf08e3c1 in term 0.
I20260807 18:47:21.124011 31145 raft_consensus.cc:2454] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7a45538a8ae4e068aa341b9bf08e3c1 in term 0.
I20260807 18:47:21.124495 30937 leader_election.cc:302] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2317cc0aac7048da9851a0e992c7412b, 90a88fb8ad464578b521d89abd86a543, b7a45538a8ae4e068aa341b9bf08e3c1; no voters:
I20260807 18:47:21.124785 31359 raft_consensus.cc:2781] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:21.124879 31359 raft_consensus.cc:482] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:21.124935 31359 raft_consensus.cc:3037] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:21.126029 31359 raft_consensus.cc:504] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.126426 31359 leader_election.cc:288] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [CANDIDATE]: Term 1 election: Requested vote from peers 90a88fb8ad464578b521d89abd86a543 (127.10.174.195:36239), 2317cc0aac7048da9851a0e992c7412b (127.10.174.194:39367)
I20260807 18:47:21.126754 31284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c379c22af554043a20982bcf721d17b" candidate_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90a88fb8ad464578b521d89abd86a543"
I20260807 18:47:21.126863 31145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c379c22af554043a20982bcf721d17b" candidate_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2317cc0aac7048da9851a0e992c7412b"
I20260807 18:47:21.126874 31284 raft_consensus.cc:3037] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:21.127046 31145 raft_consensus.cc:3037] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:21.128173 31284 raft_consensus.cc:2454] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a45538a8ae4e068aa341b9bf08e3c1 in term 1.
I20260807 18:47:21.128193 31145 raft_consensus.cc:2454] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a45538a8ae4e068aa341b9bf08e3c1 in term 1.
I20260807 18:47:21.128571 30938 leader_election.cc:302] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2317cc0aac7048da9851a0e992c7412b, 90a88fb8ad464578b521d89abd86a543, b7a45538a8ae4e068aa341b9bf08e3c1; no voters:
I20260807 18:47:21.128763 31359 raft_consensus.cc:2781] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:21.128995 31359 raft_consensus.cc:686] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 1 LEADER]: Becoming Leader. State: Replica: b7a45538a8ae4e068aa341b9bf08e3c1, State: Running, Role: LEADER
I20260807 18:47:21.129333 31359 consensus_queue.cc:237] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } }
I20260807 18:47:21.132731 30854 catalog_manager.cc:5495] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7a45538a8ae4e068aa341b9bf08e3c1 (127.10.174.193). New cstate: current_term: 1 leader_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7a45538a8ae4e068aa341b9bf08e3c1" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 43703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 } health_report { overall_health: UNKNOWN } } }
I20260807 18:47:21.163554 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.160311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32902 (local address 127.10.174.193:43703)
0807 18:47:21.160446 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.160450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.160464 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:47:21.160543 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.160546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.160603 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.160691 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:21.160907 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.161392 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.162187 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.162392 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.162464 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.162720 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:21.163132 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:21.163227 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.163329 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.163387 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:47:21.169689 31284 raft_consensus.cc:1261] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 1 FOLLOWER]: Refusing update from remote peer b7a45538a8ae4e068aa341b9bf08e3c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:21.169688 31145 raft_consensus.cc:1261] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 1 FOLLOWER]: Refusing update from remote peer b7a45538a8ae4e068aa341b9bf08e3c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:21.170619 31359 consensus_queue.cc:1035] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90a88fb8ad464578b521d89abd86a543" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 36239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:21.170848 31362 consensus_queue.cc:1035] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2317cc0aac7048da9851a0e992c7412b" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 39367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:21.181296 31366 mvcc.cc:205] Tried to move back new op lower bound from 7315982095023763456 to 7315982094868668416. Current Snapshot: MvccSnapshot[applied={T|T < 7315982095023763456}]
I20260807 18:47:21.181654 31365 mvcc.cc:205] Tried to move back new op lower bound from 7315982095023763456 to 7315982094868668416. Current Snapshot: MvccSnapshot[applied={T|T < 7315982095023763456 or (T in {7315982095023763456})}]
I20260807 18:47:21.186579 30857 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:21.186777 30857 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:21.189185 30857 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d839853083f6423ab0c1006a7be98dc6: Sending DeleteTablet for 3 replicas of tablet 8c379c22af554043a20982bcf721d17b
I20260807 18:47:21.189996 30986 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c379c22af554043a20982bcf721d17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:21 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:32896
I20260807 18:47:21.190172 31264 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c379c22af554043a20982bcf721d17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:21 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:49746
I20260807 18:47:21.190567 31125 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c379c22af554043a20982bcf721d17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:21 UTC) from {username='kudu', principal='kudu/127.10.174.254@KRBTEST.COM'} at 127.0.0.1:34886
I20260807 18:47:21.190662 31375 tablet_replica.cc:330] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: stopping tablet replica
I20260807 18:47:21.191025 31376 tablet_replica.cc:330] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: stopping tablet replica
I20260807 18:47:21.191035 31375 raft_consensus.cc:2229] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:21.191421 31375 raft_consensus.cc:2258] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:21.191444 31376 raft_consensus.cc:2229] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:21.191730 31374 tablet_replica.cc:330] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1: stopping tablet replica
I20260807 18:47:21.191866 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30921
I20260807 18:47:21.192037 31374 raft_consensus.cc:2229] T 8c379c22af554043a20982bcf721d17b P b7a45538a8ae4e068aa341b9bf08e3c1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 18:47:21.192734 31376 raft_consensus.cc:2258] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:21.194289 31376 ts_tablet_manager.cc:1905] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:21.196005 31375 ts_tablet_manager.cc:1905] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:21.197301 31376 ts_tablet_manager.cc:1918] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:21.197417 31376 log.cc:1196] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/8c379c22af554043a20982bcf721d17b
I20260807 18:47:21.197779 31376 ts_tablet_manager.cc:1939] T 8c379c22af554043a20982bcf721d17b P 2317cc0aac7048da9851a0e992c7412b: Deleting consensus metadata
I20260807 18:47:21.199163 30842 catalog_manager.cc:4841] TS 2317cc0aac7048da9851a0e992c7412b (127.10.174.194:39367): tablet 8c379c22af554043a20982bcf721d17b (table test-table [id=6037ebd6d013417da74690e160f4d154]) successfully deleted
I20260807 18:47:21.199620 31375 ts_tablet_manager.cc:1918] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:21.199707 31375 log.cc:1196] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/8c379c22af554043a20982bcf721d17b
I20260807 18:47:21.200035 31375 ts_tablet_manager.cc:1939] T 8c379c22af554043a20982bcf721d17b P 90a88fb8ad464578b521d89abd86a543: Deleting consensus metadata
W20260807 18:47:21.200918 30843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:43703 (error 108)
I20260807 18:47:21.201197 30841 catalog_manager.cc:4841] TS 90a88fb8ad464578b521d89abd86a543 (127.10.174.195:36239): tablet 8c379c22af554043a20982bcf721d17b (table test-table [id=6037ebd6d013417da74690e160f4d154]) successfully deleted
I20260807 18:47:21.201943 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31060
I20260807 18:47:21.202126 31345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.201801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:43703 (local address 127.0.0.1:32918)
0807 18:47:21.201936 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.202017 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:43703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 18:47:21.202801 30843 catalog_manager.cc:4584] TS b7a45538a8ae4e068aa341b9bf08e3c1 (127.10.174.193:43703): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8c379c22af554043a20982bcf721d17b: Network error: Client connection negotiation failed: client connection to 127.10.174.193:43703: connect: Connection refused (error 111)
I20260807 18:47:21.208724 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31198
I20260807 18:47:21.215767 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 30825
2026-08-07T18:47:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2298 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T18:47:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:21Z Disabled control of system clock
I20260807 18:47:21.248653 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33165
--webserver_interface=127.10.174.254
--webserver_port=0
--builtin_ntp_servers=127.10.174.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 18:47:21.365507 31381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:21.365803 31381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:21.365872 31381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:21.370090 31381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:21.370164 31381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:21.370180 31381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:21.370220 31381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:21.370253 31381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:21.375412 31381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:33165
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:21.376574 31381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:21.378041 31381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:21.386761 31387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:21.386814 31386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:21.386765 31389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:21.387025 31381 server_base.cc:1034] running on GCE node
I20260807 18:47:21.387866 31381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:21.389082 31381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:21.390276 31381 hybrid_clock.cc:648] HybridClock initialized: now 1786128441390263 us; error 34 us; skew 500 ppm
I20260807 18:47:21.392242 31381 webserver.cc:460] Webserver started at http://127.10.174.254:45737/ using document root <none> and password file <none>
I20260807 18:47:21.392889 31381 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:21.392982 31381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:21.393217 31381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:21.395571 31381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "575a42f159bd42f1ac7256a44e7fff9b"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "7b4f8933027d5ce71dd6fd4f093d781c"
server_key_iv: "4a39d604c940403882e2294760f65b7c"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.396165 31381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "575a42f159bd42f1ac7256a44e7fff9b"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "7b4f8933027d5ce71dd6fd4f093d781c"
server_key_iv: "4a39d604c940403882e2294760f65b7c"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.400092 31381 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 18:47:21.402623 31395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.404000 31381 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:21.404143 31381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "575a42f159bd42f1ac7256a44e7fff9b"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "7b4f8933027d5ce71dd6fd4f093d781c"
server_key_iv: "4a39d604c940403882e2294760f65b7c"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.404273 31381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:21.428126 31381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:21.428911 31381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:21.429129 31381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:21.436081 31381 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:33165
I20260807 18:47:21.436094 31451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:33165 every 8 connection(s)
I20260807 18:47:21.437104 31381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:21.440325 31452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:21.445554 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31381
I20260807 18:47:21.445698 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:21.445987 10939 external_mini_cluster.cc:1428] Setting key 5165a319285776cd37fcd76523175236
I20260807 18:47:21.446161 31452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b: Bootstrap starting.
I20260807 18:47:21.449067 31452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:21.449968 31452 log.cc:824] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:21.452255 31452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b: No bootstrap required, opened a new log
I20260807 18:47:21.456910 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.447486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60384 (local address 127.10.174.254:33165)
0807 18:47:21.448215 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.448235 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.448279 (+ 44us) server_negotiation.cc:407] Connection header received
0807 18:47:21.449184 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.449219 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.449728 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.450103 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:21.450545 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.451959 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.452954 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.453637 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.453820 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.454705 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:21.454712 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:21.454728 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:21.455235 (+ 507us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:21.455330 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:21.455358 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:21.455462 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.455601 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.455929 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":133,"threads_started":1}
I20260807 18:47:21.456915 31452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "575a42f159bd42f1ac7256a44e7fff9b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33165 } }
I20260807 18:47:21.457227 31452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:21.457278 31452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575a42f159bd42f1ac7256a44e7fff9b, State: Initialized, Role: FOLLOWER
I20260807 18:47:21.457696 31452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "575a42f159bd42f1ac7256a44e7fff9b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33165 } }
I20260807 18:47:21.457819 31452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:21.457858 31452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:21.457952 31452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:21.459123 31452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "575a42f159bd42f1ac7256a44e7fff9b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33165 } }
I20260807 18:47:21.459508 31452 leader_election.cc:302] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 575a42f159bd42f1ac7256a44e7fff9b; no voters:
I20260807 18:47:21.459837 31452 leader_election.cc:288] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:21.459967 31457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:21.460211 31457 raft_consensus.cc:686] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [term 1 LEADER]: Becoming Leader. State: Replica: 575a42f159bd42f1ac7256a44e7fff9b, State: Running, Role: LEADER
I20260807 18:47:21.460552 31457 consensus_queue.cc:237] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "575a42f159bd42f1ac7256a44e7fff9b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33165 } }
I20260807 18:47:21.461024 31452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:21.462196 31458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "575a42f159bd42f1ac7256a44e7fff9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "575a42f159bd42f1ac7256a44e7fff9b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33165 } } }
I20260807 18:47:21.462306 31458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:21.462157 31459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 575a42f159bd42f1ac7256a44e7fff9b. Latest consensus state: current_term: 1 leader_uuid: "575a42f159bd42f1ac7256a44e7fff9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "575a42f159bd42f1ac7256a44e7fff9b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33165 } } }
I20260807 18:47:21.462426 31459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:21.462697 31466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:21.465863 31466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:21.471491 31466 catalog_manager.cc:1347] Generated new cluster ID: 1e8cfea52b024fe0b50fc66f43222e98
I20260807 18:47:21.471566 31466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:21.483961 31466 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:21.484954 31466 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:21.492439 31466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b: Generated new TSK 0
I20260807 18:47:21.493166 31466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:21.500066 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.193:0
--local_ip_for_outbound_sockets=127.10.174.193
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33165
--builtin_ntp_servers=127.10.174.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 18:47:21.617911 31477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:21.618176 31477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:21.618214 31477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:21.622332 31477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:21.622396 31477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:21.622480 31477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.193
I20260807 18:47:21.627215 31477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.174.193
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.193
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:21.628517 31477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:21.629927 31477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:21.639559 31485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:21.639621 31477 server_base.cc:1034] running on GCE node
W20260807 18:47:21.639567 31483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:21.639569 31482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:21.640123 31477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:21.640782 31477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:21.641961 31477 hybrid_clock.cc:648] HybridClock initialized: now 1786128441641944 us; error 29 us; skew 500 ppm
I20260807 18:47:21.648124 31477 webserver.cc:460] Webserver started at http://127.10.174.193:38121/ using document root <none> and password file <none>
I20260807 18:47:21.648730 31477 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:21.648829 31477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:21.649062 31477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:21.651147 31477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data/instance:
uuid: "5e97bd5720724cd0a99653ea32c58b6c"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "a43fd322c8989af33b49b7d74d609d62"
server_key_iv: "c2b8f523e8265dfbc11f132f892d3c53"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.651782 31477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance:
uuid: "5e97bd5720724cd0a99653ea32c58b6c"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "a43fd322c8989af33b49b7d74d609d62"
server_key_iv: "c2b8f523e8265dfbc11f132f892d3c53"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.655437 31477 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:21.657891 31491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.659137 31477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:21.659272 31477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal
uuid: "5e97bd5720724cd0a99653ea32c58b6c"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "a43fd322c8989af33b49b7d74d609d62"
server_key_iv: "c2b8f523e8265dfbc11f132f892d3c53"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.659451 31477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:21.684639 31477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:21.685437 31477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:21.685667 31477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:21.686291 31477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:21.687301 31477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:21.687372 31477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.687446 31477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:21.687485 31477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.696970 31477 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.193:46073
I20260807 18:47:21.696990 31607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.193:46073 every 8 connection(s)
I20260807 18:47:21.697902 31477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/data/info.pb
I20260807 18:47:21.700042 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31477
I20260807 18:47:21.700174 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-0/wal/instance
I20260807 18:47:21.700474 10939 external_mini_cluster.cc:1428] Setting key 8e15f908e2b2b0d911639dfd674ab748
I20260807 18:47:21.702517 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.194:0
--local_ip_for_outbound_sockets=127.10.174.194
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33165
--builtin_ntp_servers=127.10.174.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 18:47:21.708367 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.699755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:33583 (local address 127.10.174.254:33165)
0807 18:47:21.699940 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.699946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.701108 (+ 1162us) server_negotiation.cc:407] Connection header received
0807 18:47:21.702671 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.702674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.702732 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.702827 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:21.703786 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.704580 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.705875 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.706313 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.706440 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.707759 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:21.707762 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:21.707764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:21.707777 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:21.707797 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:21.707806 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:21.707875 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.708183 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.708245 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 18:47:21.709750 31610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.700170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33165 (local address 127.10.174.193:33583)
0807 18:47:21.700955 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.701008 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.702445 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.703002 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.703009 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.703091 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:21.703637 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.703651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.704851 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.704854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.705746 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.705757 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.706486 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.706489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.706634 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.707347 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:21.707351 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:21.707415 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:21.707514 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:21.707954 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:21.707968 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:21.707978 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.708151 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.708502 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":131,"threads_started":1}
I20260807 18:47:21.711125 31608 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33165
I20260807 18:47:21.711445 31608 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:21.712194 31608 heartbeater.cc:511] Master 127.10.174.254:33165 requested a full tablet report, sending...
I20260807 18:47:21.713871 31415 ts_manager.cc:194] Registered new tserver with Master: 5e97bd5720724cd0a99653ea32c58b6c (127.10.174.193:46073)
I20260807 18:47:21.715065 31415 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.193:33583
W20260807 18:47:21.818209 31611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:21.818495 31611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:21.818534 31611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:21.822743 31611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:21.822810 31611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:21.822894 31611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.194
I20260807 18:47:21.827677 31611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.174.194
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.194
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:21.828899 31611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:21.830327 31611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:21.840435 31620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:21.840538 31611 server_base.cc:1034] running on GCE node
W20260807 18:47:21.840431 31616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:21.840425 31617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:21.841115 31611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:21.841743 31611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:21.842924 31611 hybrid_clock.cc:648] HybridClock initialized: now 1786128441842880 us; error 42 us; skew 500 ppm
I20260807 18:47:21.845024 31611 webserver.cc:460] Webserver started at http://127.10.174.194:45543/ using document root <none> and password file <none>
I20260807 18:47:21.845628 31611 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:21.845719 31611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:21.845932 31611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:21.848053 31611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data/instance:
uuid: "6a00d35aeee84ba480fb1d1dc5978bc4"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "74cc6485954f9d5ac06887a1802c8cf6"
server_key_iv: "a846517be0c94a6e751c12fa4379f039"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.848662 31611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance:
uuid: "6a00d35aeee84ba480fb1d1dc5978bc4"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "74cc6485954f9d5ac06887a1802c8cf6"
server_key_iv: "a846517be0c94a6e751c12fa4379f039"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.852782 31611 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 18:47:21.855509 31626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.856884 31611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 18:47:21.857026 31611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal
uuid: "6a00d35aeee84ba480fb1d1dc5978bc4"
format_stamp: "Formatted at 2026-08-07 18:47:21 on dist-test-slave-07c2"
server_key: "74cc6485954f9d5ac06887a1802c8cf6"
server_key_iv: "a846517be0c94a6e751c12fa4379f039"
server_key_version: "encryptionkey@0"
I20260807 18:47:21.857164 31611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:21.868556 31611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:21.869268 31611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:21.869472 31611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:21.870148 31611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:21.871097 31611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:21.871146 31611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.871212 31611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:21.871249 31611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:21.882216 31611 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.194:33331
I20260807 18:47:21.882282 31744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.194:33331 every 8 connection(s)
I20260807 18:47:21.883342 31611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/data/info.pb
I20260807 18:47:21.891651 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31611
I20260807 18:47:21.891819 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal/instance
I20260807 18:47:21.892168 10939 external_mini_cluster.cc:1428] Setting key 5ee64eafbf65b770ea42ad8baa06a6dc
I20260807 18:47:21.894698 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.174.195:0
--local_ip_for_outbound_sockets=127.10.174.195
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33165
--builtin_ntp_servers=127.10.174.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 18:47:21.897997 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.885499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.194:48821 (local address 127.10.174.254:33165)
0807 18:47:21.885672 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:21.885676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:21.886750 (+ 1074us) server_negotiation.cc:407] Connection header received
0807 18:47:21.890749 (+ 3999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:21.890753 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:21.890834 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:21.890946 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:21.892319 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.893225 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.895489 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.895808 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.895926 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.897408 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:21.897414 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:21.897418 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:21.897439 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:21.897468 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:21.897482 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:21.897562 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:21.897711 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 18:47:21.897778 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 18:47:21.898996 31747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:21.885860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33165 (local address 127.10.174.194:48821)
0807 18:47:21.886520 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:21.886611 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:21.890438 (+ 3827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:21.891176 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:21.891186 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:21.891348 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:21.892113 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.892135 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.893404 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.893410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.895356 (+ 1946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:21.895369 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:21.896107 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:21.896110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:21.896354 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:21.897092 (+ 738us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:21.897094 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:21.897138 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:21.897209 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:21.897567 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:21.897573 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:21.897577 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 18:47:21.897669 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 18:47:21.897934 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":106,"threads_started":1}
I20260807 18:47:21.900338 31745 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33165
I20260807 18:47:21.900594 31745 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:21.901233 31745 heartbeater.cc:511] Master 127.10.174.254:33165 requested a full tablet report, sending...
I20260807 18:47:21.902482 31415 ts_manager.cc:194] Registered new tserver with Master: 6a00d35aeee84ba480fb1d1dc5978bc4 (127.10.174.194:33331)
I20260807 18:47:21.903061 31415 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.194:48821
W20260807 18:47:22.020023 31748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:22.020306 31748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:22.020398 31748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:22.024422 31748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:22.024485 31748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:22.024585 31748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.174.195
I20260807 18:47:22.029723 31748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.174.195
--webserver_port=0
--tserver_master_addrs=127.10.174.254:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.174.195
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:22.030911 31748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:22.032349 31748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:22.042019 31756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:22.042042 31754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:22.042037 31753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:22.042140 31748 server_base.cc:1034] running on GCE node
I20260807 18:47:22.042666 31748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:22.043370 31748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:22.044533 31748 hybrid_clock.cc:648] HybridClock initialized: now 1786128442044514 us; error 29 us; skew 500 ppm
I20260807 18:47:22.046438 31748 webserver.cc:460] Webserver started at http://127.10.174.195:37073/ using document root <none> and password file <none>
I20260807 18:47:22.047029 31748 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:22.047094 31748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:22.047355 31748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:22.049525 31748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data/instance:
uuid: "ad9ce61936c649d398d6929e851e9512"
format_stamp: "Formatted at 2026-08-07 18:47:22 on dist-test-slave-07c2"
server_key: "a7a04b319f3af90e0af3ee999504a2b9"
server_key_iv: "65d526861d8e7a475da6850faa5a52f4"
server_key_version: "encryptionkey@0"
I20260807 18:47:22.050107 31748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance:
uuid: "ad9ce61936c649d398d6929e851e9512"
format_stamp: "Formatted at 2026-08-07 18:47:22 on dist-test-slave-07c2"
server_key: "a7a04b319f3af90e0af3ee999504a2b9"
server_key_iv: "65d526861d8e7a475da6850faa5a52f4"
server_key_version: "encryptionkey@0"
I20260807 18:47:22.053880 31748 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 18:47:22.056536 31763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:22.057842 31748 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:22.057981 31748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal
uuid: "ad9ce61936c649d398d6929e851e9512"
format_stamp: "Formatted at 2026-08-07 18:47:22 on dist-test-slave-07c2"
server_key: "a7a04b319f3af90e0af3ee999504a2b9"
server_key_iv: "65d526861d8e7a475da6850faa5a52f4"
server_key_version: "encryptionkey@0"
I20260807 18:47:22.058099 31748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:22.074774 31748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:22.075536 31748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:22.075734 31748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:22.076345 31748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 18:47:22.077313 31748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 18:47:22.077382 31748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:22.077450 31748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 18:47:22.077497 31748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:22.086227 31748 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.195:33027
I20260807 18:47:22.086265 31880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.195:33027 every 8 connection(s)
I20260807 18:47:22.087147 31748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/data/info.pb
I20260807 18:47:22.095104 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31748
I20260807 18:47:22.095242 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal/instance
I20260807 18:47:22.095635 10939 external_mini_cluster.cc:1428] Setting key 8d8a611bb510d32420d9c4b3bf2e8893
I20260807 18:47:22.096654 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.089055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.195:46095 (local address 127.10.174.254:33165)
0807 18:47:22.089208 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.089213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.090474 (+ 1261us) server_negotiation.cc:407] Connection header received
0807 18:47:22.091884 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.091887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.091936 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.092015 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:22.092836 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.093365 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.094447 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.094667 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.094745 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.096029 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:22.096034 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:22.096036 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:22.096052 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:22.096074 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:22.096086 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:22.096166 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.096427 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.096491 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:47:22.097494 31883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.089541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33165 (local address 127.10.174.195:46095)
0807 18:47:22.090331 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.090374 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:22.091670 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:22.092143 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:22.092149 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:22.092229 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:22.092703 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.092715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.093469 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.093471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.094344 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.094353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.094840 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.094846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.095043 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.095706 (+ 663us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 18:47:22.095709 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:22.095771 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 18:47:22.095848 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:22.096186 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:22.096196 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:22.096202 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 18:47:22.096343 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 18:47:22.096640 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":111,"threads_started":1}
I20260807 18:47:22.098505 31881 heartbeater.cc:347] Connected to a master server at 127.10.174.254:33165
I20260807 18:47:22.098707 31881 heartbeater.cc:464] Registering TS with master...
I20260807 18:47:22.099167 31881 heartbeater.cc:511] Master 127.10.174.254:33165 requested a full tablet report, sending...
I20260807 18:47:22.100154 31415 ts_manager.cc:194] Registered new tserver with Master: ad9ce61936c649d398d6929e851e9512 (127.10.174.195:33027)
I20260807 18:47:22.100708 31415 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.174.195:46095
I20260807 18:47:22.109647 10939 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 18:47:22.115571 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.111736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60388 (local address 127.10.174.254:33165)
0807 18:47:22.111898 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.111903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.112072 (+ 169us) server_negotiation.cc:407] Connection header received
0807 18:47:22.112216 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.112220 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.112267 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.112365 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:22.112662 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.113177 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.114015 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.114237 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.114348 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.115116 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:22.115120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:22.115122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:22.115139 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:22.115158 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:22.115166 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:22.115241 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.115361 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.115416 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 18:47:22.118295 31415 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 18:47:22.121397 31415 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 18:47:22.135653 31895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.129681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:46073 (local address 127.0.0.1:55088)
0807 18:47:22.130524 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.130576 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:22.130710 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:22.131478 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:22.131481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:22.131499 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:22.131633 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.131639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.133134 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.133136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.134103 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.134114 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.135074 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.135078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.135187 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.135230 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 18:47:22.135369 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 18:47:22.135491 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":102,"thread_start_us":104,"threads_started":1}
I20260807 18:47:22.135937 31894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.129812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55088 (local address 127.10.174.193:46073)
0807 18:47:22.130515 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.130526 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.130853 (+ 327us) server_negotiation.cc:407] Connection header received
0807 18:47:22.130937 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.130943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.131143 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.131307 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:22.131820 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.132979 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.134231 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.134972 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.135095 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.135271 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.135660 (+ 389us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.135791 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":149,"threads_started":1}
I20260807 18:47:22.135866 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.130072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:33331 (local address 127.0.0.1:49922)
0807 18:47:22.131139 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.131153 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:22.131247 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:22.131896 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:22.131898 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:22.131912 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:22.131970 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.131974 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.132928 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.132933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.134314 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.134325 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.135399 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.135403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.135510 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.135533 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 18:47:22.135622 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 18:47:22.135696 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"mutex_wait_us":43,"thread_start_us":92,"threads_started":1}
I20260807 18:47:22.136225 31897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.130516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.10.174.194:33331)
0807 18:47:22.130992 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.131004 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.131389 (+ 385us) server_negotiation.cc:407] Connection header received
0807 18:47:22.131467 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.131472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.131640 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.131776 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:22.132082 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.132812 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.134442 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.135250 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.135413 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.135564 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.135960 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.136059 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":111,"threads_started":1}
I20260807 18:47:22.137032 31896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.130504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.10.174.195:33027)
0807 18:47:22.131016 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.131026 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.131046 (+ 20us) server_negotiation.cc:407] Connection header received
0807 18:47:22.131109 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.131113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.131280 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.131447 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:22.131758 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.132979 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.134987 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.135810 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.136524 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.136706 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.136771 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.136868 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":108,"threads_started":1}
I20260807 18:47:22.137466 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.129788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:33027 (local address 127.0.0.1:51180)
0807 18:47:22.130649 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.130661 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:22.130722 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:22.131445 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:22.131451 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:22.131476 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:22.131620 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.131627 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.133101 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.133104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.134855 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.134865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.135953 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.135957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.136041 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.136063 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 18:47:22.136113 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 18:47:22.136181 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"mutex_wait_us":47,"spinlock_wait_cycles":2816,"thread_start_us":106,"threads_started":1}
I20260807 18:47:22.139338 31674 tablet_service.cc:1467] Processing CreateTablet for tablet b76b6d3f120048019dc87efc3bbd0f89 (DEFAULT_TABLE table=test-table [id=047ea176691a4707966bd8adfaaa4bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:22.139343 31541 tablet_service.cc:1467] Processing CreateTablet for tablet b76b6d3f120048019dc87efc3bbd0f89 (DEFAULT_TABLE table=test-table [id=047ea176691a4707966bd8adfaaa4bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:22.139642 31814 tablet_service.cc:1467] Processing CreateTablet for tablet b76b6d3f120048019dc87efc3bbd0f89 (DEFAULT_TABLE table=test-table [id=047ea176691a4707966bd8adfaaa4bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 18:47:22.140468 31541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b76b6d3f120048019dc87efc3bbd0f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:22.140468 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b76b6d3f120048019dc87efc3bbd0f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:22.140551 31814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b76b6d3f120048019dc87efc3bbd0f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:22.146533 31898 tablet_bootstrap.cc:492] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Bootstrap starting.
I20260807 18:47:22.148080 31899 tablet_bootstrap.cc:492] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Bootstrap starting.
I20260807 18:47:22.148881 31898 tablet_bootstrap.cc:654] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:22.149583 31898 log.cc:824] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:22.150017 31899 tablet_bootstrap.cc:654] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:22.150233 31900 tablet_bootstrap.cc:492] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: Bootstrap starting.
I20260807 18:47:22.150839 31899 log.cc:824] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:22.151698 31898 tablet_bootstrap.cc:492] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: No bootstrap required, opened a new log
I20260807 18:47:22.151906 31898 ts_tablet_manager.cc:1397] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 18:47:22.152052 31900 tablet_bootstrap.cc:654] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:22.152674 31900 log.cc:824] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:22.152858 31899 tablet_bootstrap.cc:492] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: No bootstrap required, opened a new log
I20260807 18:47:22.153036 31899 ts_tablet_manager.cc:1397] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:47:22.154505 31900 tablet_bootstrap.cc:492] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: No bootstrap required, opened a new log
I20260807 18:47:22.154683 31900 ts_tablet_manager.cc:1397] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 18:47:22.156370 31898 raft_consensus.cc:348] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.156673 31898 raft_consensus.cc:374] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:22.156730 31898 raft_consensus.cc:729] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad9ce61936c649d398d6929e851e9512, State: Initialized, Role: FOLLOWER
I20260807 18:47:22.157207 31898 consensus_queue.cc:260] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.157286 31899 raft_consensus.cc:348] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.157574 31899 raft_consensus.cc:374] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:22.157646 31899 raft_consensus.cc:729] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a00d35aeee84ba480fb1d1dc5978bc4, State: Initialized, Role: FOLLOWER
I20260807 18:47:22.158056 31899 consensus_queue.cc:260] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.158089 31900 raft_consensus.cc:348] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.158315 31900 raft_consensus.cc:374] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:22.158316 31898 ts_tablet_manager.cc:1428] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 18:47:22.158380 31900 raft_consensus.cc:729] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e97bd5720724cd0a99653ea32c58b6c, State: Initialized, Role: FOLLOWER
I20260807 18:47:22.158679 31881 heartbeater.cc:503] Master 127.10.174.254:33165 was elected leader, sending a full tablet report...
I20260807 18:47:22.158789 31745 heartbeater.cc:503] Master 127.10.174.254:33165 was elected leader, sending a full tablet report...
I20260807 18:47:22.158841 31900 consensus_queue.cc:260] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.158978 31899 ts_tablet_manager.cc:1428] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 18:47:22.159587 31608 heartbeater.cc:503] Master 127.10.174.254:33165 was elected leader, sending a full tablet report...
I20260807 18:47:22.159710 31900 ts_tablet_manager.cc:1428] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 18:47:22.199115 31609 tablet.cc:2369] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 18:47:22.338203 31882 tablet.cc:2369] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:22.361649 31906 raft_consensus.cc:482] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:22.361943 31906 raft_consensus.cc:504] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.363502 31906 leader_election.cc:288] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad9ce61936c649d398d6929e851e9512 (127.10.174.195:33027), 6a00d35aeee84ba480fb1d1dc5978bc4 (127.10.174.194:33331)
I20260807 18:47:22.368651 31896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.363941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:57057 (local address 127.10.174.195:33027)
0807 18:47:22.364077 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.364082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.364249 (+ 167us) server_negotiation.cc:407] Connection header received
0807 18:47:22.364373 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.364379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.364431 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.364511 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:22.364840 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.365528 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.367380 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.368023 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.368174 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.368234 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.368433 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.368524 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:47:22.368714 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.363773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.195:33027 (local address 127.10.174.193:57057)
0807 18:47:22.364146 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.364165 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:22.364267 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:22.364532 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:22.364535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:22.364553 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:22.364711 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.364718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.365891 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.365894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.367237 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.367243 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.368166 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.368173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.368290 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.368317 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 18:47:22.368412 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 18:47:22.368492 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":67,"thread_start_us":106,"threads_started":1}
I20260807 18:47:22.369439 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b76b6d3f120048019dc87efc3bbd0f89" candidate_uuid: "5e97bd5720724cd0a99653ea32c58b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9ce61936c649d398d6929e851e9512" is_pre_election: true
I20260807 18:47:22.369525 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.363843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.194:33331 (local address 127.10.174.193:48127)
0807 18:47:22.364299 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.364314 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:22.364417 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:22.364693 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:22.364695 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:22.364709 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 18:47:22.364843 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.364849 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.365775 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.365778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.367228 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:22.367239 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.369163 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.369167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:22.369277 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.369294 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 18:47:22.369358 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 18:47:22.369411 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":38,"thread_start_us":116,"threads_started":1}
I20260807 18:47:22.369616 31897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.363932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.174.193:48127 (local address 127.10.174.194:33331)
0807 18:47:22.364072 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.364077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.364411 (+ 334us) server_negotiation.cc:407] Connection header received
0807 18:47:22.364535 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.364538 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.364587 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.364668 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 18:47:22.364957 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.365638 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.368301 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.368941 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.369061 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.369105 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.369405 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.369497 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:47:22.369828 31834 raft_consensus.cc:2454] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e97bd5720724cd0a99653ea32c58b6c in term 0.
I20260807 18:47:22.370385 31495 leader_election.cc:302] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e97bd5720724cd0a99653ea32c58b6c, ad9ce61936c649d398d6929e851e9512; no voters:
I20260807 18:47:22.370708 31906 raft_consensus.cc:2781] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 18:47:22.370680 31678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b76b6d3f120048019dc87efc3bbd0f89" candidate_uuid: "5e97bd5720724cd0a99653ea32c58b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" is_pre_election: true
I20260807 18:47:22.370808 31906 raft_consensus.cc:482] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 18:47:22.370877 31906 raft_consensus.cc:3037] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:22.371064 31678 raft_consensus.cc:2454] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e97bd5720724cd0a99653ea32c58b6c in term 0.
I20260807 18:47:22.372189 31906 raft_consensus.cc:504] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.372529 31906 leader_election.cc:288] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [CANDIDATE]: Term 1 election: Requested vote from peers ad9ce61936c649d398d6929e851e9512 (127.10.174.195:33027), 6a00d35aeee84ba480fb1d1dc5978bc4 (127.10.174.194:33331)
I20260807 18:47:22.372874 31834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b76b6d3f120048019dc87efc3bbd0f89" candidate_uuid: "5e97bd5720724cd0a99653ea32c58b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad9ce61936c649d398d6929e851e9512"
I20260807 18:47:22.372874 31678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b76b6d3f120048019dc87efc3bbd0f89" candidate_uuid: "5e97bd5720724cd0a99653ea32c58b6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4"
I20260807 18:47:22.373003 31678 raft_consensus.cc:3037] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:22.373003 31834 raft_consensus.cc:3037] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:22.374308 31834 raft_consensus.cc:2454] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e97bd5720724cd0a99653ea32c58b6c in term 1.
I20260807 18:47:22.374308 31678 raft_consensus.cc:2454] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e97bd5720724cd0a99653ea32c58b6c in term 1.
I20260807 18:47:22.374637 31493 leader_election.cc:302] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5e97bd5720724cd0a99653ea32c58b6c, 6a00d35aeee84ba480fb1d1dc5978bc4, ad9ce61936c649d398d6929e851e9512; no voters:
I20260807 18:47:22.374809 31906 raft_consensus.cc:2781] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:22.375010 31906 raft_consensus.cc:686] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [term 1 LEADER]: Becoming Leader. State: Replica: 5e97bd5720724cd0a99653ea32c58b6c, State: Running, Role: LEADER
I20260807 18:47:22.375349 31906 consensus_queue.cc:237] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } }
I20260807 18:47:22.378679 31415 catalog_manager.cc:5495] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e97bd5720724cd0a99653ea32c58b6c (127.10.174.193). New cstate: current_term: 1 leader_uuid: "5e97bd5720724cd0a99653ea32c58b6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e97bd5720724cd0a99653ea32c58b6c" member_type: VOTER last_known_addr { host: "127.10.174.193" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 } health_report { overall_health: UNKNOWN } } }
W20260807 18:47:22.384732 31746 tablet.cc:2369] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 18:47:22.431238 31894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.427767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.10.174.193:46073)
0807 18:47:22.427904 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:22.427907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:22.427922 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:47:22.428057 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:22.428059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:22.428115 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:22.428204 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:22.428483 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.429001 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.429840 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:22.430132 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:22.430207 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:22.430473 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:22.430876 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:22.430964 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:22.431020 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 18:47:22.431065 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:47:22.437220 31834 raft_consensus.cc:1261] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 1 FOLLOWER]: Refusing update from remote peer 5e97bd5720724cd0a99653ea32c58b6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:22.437224 31678 raft_consensus.cc:1261] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 1 FOLLOWER]: Refusing update from remote peer 5e97bd5720724cd0a99653ea32c58b6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:22.437999 31906 consensus_queue.cc:1035] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad9ce61936c649d398d6929e851e9512" member_type: VOTER last_known_addr { host: "127.10.174.195" port: 33027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:22.438220 31909 consensus_queue.cc:1035] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a00d35aeee84ba480fb1d1dc5978bc4" member_type: VOTER last_known_addr { host: "127.10.174.194" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:22.446820 31913 mvcc.cc:205] Tried to move back new op lower bound from 7315982100215255040 to 7315982099971825664. Current Snapshot: MvccSnapshot[applied={T|T < 7315982100215255040}]
I20260807 18:47:22.447171 31914 mvcc.cc:205] Tried to move back new op lower bound from 7315982100215255040 to 7315982099971825664. Current Snapshot: MvccSnapshot[applied={T|T < 7315982100215255040}]
I20260807 18:47:22.456982 31413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:22.457172 31413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 18:47:22.459821 31413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 575a42f159bd42f1ac7256a44e7fff9b: Sending DeleteTablet for 3 replicas of tablet b76b6d3f120048019dc87efc3bbd0f89
I20260807 18:47:22.460645 31541 tablet_service.cc:1514] Processing DeleteTablet for tablet b76b6d3f120048019dc87efc3bbd0f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:22 UTC) from {username='slave'} at 127.0.0.1:55088
I20260807 18:47:22.460695 31814 tablet_service.cc:1514] Processing DeleteTablet for tablet b76b6d3f120048019dc87efc3bbd0f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:22 UTC) from {username='slave'} at 127.0.0.1:51180
I20260807 18:47:22.460819 31674 tablet_service.cc:1514] Processing DeleteTablet for tablet b76b6d3f120048019dc87efc3bbd0f89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 18:47:22 UTC) from {username='slave'} at 127.0.0.1:49922
I20260807 18:47:22.461390 31925 tablet_replica.cc:330] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: stopping tablet replica
I20260807 18:47:22.461400 31926 tablet_replica.cc:330] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: stopping tablet replica
I20260807 18:47:22.461833 31925 raft_consensus.cc:2229] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:22.462195 31924 tablet_replica.cc:330] T b76b6d3f120048019dc87efc3bbd0f89 P 5e97bd5720724cd0a99653ea32c58b6c: stopping tablet replica
I20260807 18:47:22.462227 31925 raft_consensus.cc:2258] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:22.462293 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31477
I20260807 18:47:22.461822 31926 raft_consensus.cc:2229] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 18:47:22.464707 31926 raft_consensus.cc:2258] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 18:47:22.465917 31925 ts_tablet_manager.cc:1905] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:22.466150 31926 ts_tablet_manager.cc:1905] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 18:47:22.468783 31925 ts_tablet_manager.cc:1918] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:22.468783 31926 ts_tablet_manager.cc:1918] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 18:47:22.468892 31925 log.cc:1196] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-2/wal/wals/b76b6d3f120048019dc87efc3bbd0f89
I20260807 18:47:22.468892 31926 log.cc:1196] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Deleting WAL directory at /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786128190976416-10939-0/minicluster-data/ts-1/wal/wals/b76b6d3f120048019dc87efc3bbd0f89
I20260807 18:47:22.469223 31926 ts_tablet_manager.cc:1939] T b76b6d3f120048019dc87efc3bbd0f89 P 6a00d35aeee84ba480fb1d1dc5978bc4: Deleting consensus metadata
I20260807 18:47:22.469223 31925 ts_tablet_manager.cc:1939] T b76b6d3f120048019dc87efc3bbd0f89 P ad9ce61936c649d398d6929e851e9512: Deleting consensus metadata
W20260807 18:47:22.470377 31396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.174.193:46073 (error 108)
I20260807 18:47:22.470686 31397 catalog_manager.cc:4841] TS 6a00d35aeee84ba480fb1d1dc5978bc4 (127.10.174.194:33331): tablet b76b6d3f120048019dc87efc3bbd0f89 (table test-table [id=047ea176691a4707966bd8adfaaa4bd0]) successfully deleted
I20260807 18:47:22.470711 31400 catalog_manager.cc:4841] TS ad9ce61936c649d398d6929e851e9512 (127.10.174.195:33027): tablet b76b6d3f120048019dc87efc3bbd0f89 (table test-table [id=047ea176691a4707966bd8adfaaa4bd0]) successfully deleted
I20260807 18:47:22.471359 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31611
I20260807 18:47:22.471717 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:22.471373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.193:46073 (local address 127.0.0.1:55110)
0807 18:47:22.471524 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:22.471609 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.193:46073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 18:47:22.472363 31396 catalog_manager.cc:4584] TS 5e97bd5720724cd0a99653ea32c58b6c (127.10.174.193:46073): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b76b6d3f120048019dc87efc3bbd0f89: Network error: Client connection negotiation failed: client connection to 127.10.174.193:46073: connect: Connection refused (error 111)
I20260807 18:47:22.478399 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31748
I20260807 18:47:22.485147 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31381
2026-08-07T18:47:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1268 ms)
[----------] 6 tests from EncryptionPolicyTest (10963 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:22 dist-test-slave-07c2 krb5kdc[31930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:22 dist-test-slave-07c2 krb5kdc[31930](info): set up 2 sockets
Aug 07 18:47:22 dist-test-slave-07c2 krb5kdc[31930](info): commencing operation
krb5kdc: starting...
W20260807 18:47:23.537981 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:23 dist-test-slave-07c2 krb5kdc[31930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:23.664644 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40113
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:23.773851 31943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:23.774132 31943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:23.774175 31943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:23.778223 31943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:23.778285 31943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:23.778303 31943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:23.778321 31943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:23.778337 31943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:23.783466 31943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40113
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:23.784423 31943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:23.785372 31943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:23.793708 31949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:23.793720 31948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:23.793876 31951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:23.793747 31943 server_base.cc:1034] running on GCE node
I20260807 18:47:23.794507 31943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:23.795665 31943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:23.796849 31943 hybrid_clock.cc:648] HybridClock initialized: now 1786128443796835 us; error 26 us; skew 500 ppm
Aug 07 18:47:23 dist-test-slave-07c2 krb5kdc[31930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128443, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:23.799618 31943 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:23.800434 31943 webserver.cc:460] Webserver started at http://127.0.0.1:41579/ using document root <none> and password file <none>
I20260807 18:47:23.800984 31943 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:23.801046 31943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:23.801208 31943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:23.803151 31943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2"
format_stamp: "Formatted at 2026-08-07 18:47:23 on dist-test-slave-07c2"
server_key: "e1804e6dbd3732cecedd6a353b4c55e8"
server_key_iv: "458f9e8e5c8332127f6727733766b27b"
server_key_version: "encryptionkey@0"
I20260807 18:47:23.803738 31943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2"
format_stamp: "Formatted at 2026-08-07 18:47:23 on dist-test-slave-07c2"
server_key: "e1804e6dbd3732cecedd6a353b4c55e8"
server_key_iv: "458f9e8e5c8332127f6727733766b27b"
server_key_version: "encryptionkey@0"
I20260807 18:47:23.807418 31943 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:23.809790 31958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:23.811012 31943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:23.811110 31943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2"
format_stamp: "Formatted at 2026-08-07 18:47:23 on dist-test-slave-07c2"
server_key: "e1804e6dbd3732cecedd6a353b4c55e8"
server_key_iv: "458f9e8e5c8332127f6727733766b27b"
server_key_version: "encryptionkey@0"
I20260807 18:47:23.811199 31943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:23.828529 31943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:23.831419 31943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:23.831575 31943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:23.838661 31943 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40113
I20260807 18:47:23.838688 32010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40113 every 8 connection(s)
I20260807 18:47:23.839677 31943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:23.841353 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 31943
I20260807 18:47:23.841488 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:23.841784 10939 external_mini_cluster.cc:1428] Setting key cbaa6447971d18e4e4f7401f11667fc2
I20260807 18:47:23.842522 32011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:23.848063 32011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2: Bootstrap starting.
I20260807 18:47:23.850189 32011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2: Neither blocks nor log segments found. Creating new log.
Aug 07 18:47:23 dist-test-slave-07c2 krb5kdc[31930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 18:47:23.850909 32011 log.cc:824] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:23.852777 32011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2: No bootstrap required, opened a new log
I20260807 18:47:23.855531 32014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:23.843203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38013 (local address 127.0.0.1:40113)
0807 18:47:23.843651 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:23.843666 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:23.843700 (+ 34us) server_negotiation.cc:407] Connection header received
0807 18:47:23.844349 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:23.844364 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:23.844669 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:23.844994 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:23.845805 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:23.846764 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:23.847672 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:23.848172 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:23.848353 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:23.850812 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:23.850817 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:23.850830 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:23.850857 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:23.852651 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:23.853200 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:23.853205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:23.853209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:23.853325 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:23.853668 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:23.853676 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:23.853677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:23.854048 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:23.854290 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:23.854555 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 18:47:23.854772 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":148,"threads_started":1}
I20260807 18:47:23.856385 32011 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40113 } }
I20260807 18:47:23.856617 32011 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:23.856693 32011 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce7ec1f2e74433db2a8a3b1166bf6a2, State: Initialized, Role: FOLLOWER
I20260807 18:47:23.857091 32011 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40113 } }
I20260807 18:47:23.857242 32011 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:23.857322 32011 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:23.857431 32011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:23.858520 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:23.858512 32011 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40113 } }
I20260807 18:47:23.858840 32011 leader_election.cc:302] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ce7ec1f2e74433db2a8a3b1166bf6a2; no voters:
I20260807 18:47:23.859143 32011 leader_election.cc:288] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:23.859262 32016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:23.859545 32016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [term 1 LEADER]: Becoming Leader. State: Replica: 7ce7ec1f2e74433db2a8a3b1166bf6a2, State: Running, Role: LEADER
I20260807 18:47:23.859874 32016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40113 } }
I20260807 18:47:23.860446 32011 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:23.861208 32018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ce7ec1f2e74433db2a8a3b1166bf6a2. Latest consensus state: current_term: 1 leader_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40113 } } }
I20260807 18:47:23.861349 32018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:23.861639 32017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ce7ec1f2e74433db2a8a3b1166bf6a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40113 } } }
I20260807 18:47:23.861742 32017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:23.861761 32029 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:23.864938 32029 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:23.871714 32029 catalog_manager.cc:1347] Generated new cluster ID: 9d99a701bf094b8fbaba0bfe86e554b6
I20260807 18:47:23.871845 32029 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:23.872349 32014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:23.861056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53603 (local address 127.0.0.1:40113)
0807 18:47:23.861188 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:23.861195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:23.862864 (+ 1669us) server_negotiation.cc:407] Connection header received
0807 18:47:23.863016 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:23.863020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:23.863073 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:23.863137 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:23.864138 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:23.864683 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:23.865816 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:23.866160 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:23.866276 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:23.867908 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:23.867914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:23.867917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:23.867945 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:23.869824 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:23.870357 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:23.870361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:23.870364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:23.870458 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:23.870956 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:23.870959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:23.870961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:23.871184 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:23.871974 (+ 790us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:23.872078 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 18:47:23.872180 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 18:47:23.878911 32029 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:23.879959 32029 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:23.887991 32029 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ce7ec1f2e74433db2a8a3b1166bf6a2: Generated new TSK 0
I20260807 18:47:23.888836 32029 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:23.894091 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 31943
W20260807 18:47:23.901613 31928 connection.cc:535] client connection to 127.0.0.1:40113 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40113): Connection reset by peer (error 104)
2026-08-07T18:47:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1408 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:23 dist-test-slave-07c2 krb5kdc[32042](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:23 dist-test-slave-07c2 krb5kdc[32042](info): set up 2 sockets
Aug 07 18:47:23 dist-test-slave-07c2 krb5kdc[32042](info): commencing operation
krb5kdc: starting...
W20260807 18:47:24.946448 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:25 dist-test-slave-07c2 krb5kdc[32042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:25.074586 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40349
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:25.187529 32056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:25.187853 32056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:25.187928 32056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:25.192107 32056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:25.192204 32056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:25.192242 32056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:25.192302 32056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:25.192342 32056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:25.197868 32056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40349
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:25.199071 32056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:25.200177 32056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:25.209077 32062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:25.209147 32056 server_base.cc:1034] running on GCE node
W20260807 18:47:25.209118 32064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:25.209085 32061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:25.209878 32056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:25.211035 32056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:25.212252 32056 hybrid_clock.cc:648] HybridClock initialized: now 1786128445212224 us; error 37 us; skew 500 ppm
Aug 07 18:47:25 dist-test-slave-07c2 krb5kdc[32042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128445, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:25.215459 32056 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:25.216657 32056 webserver.cc:460] Webserver started at http://127.0.0.1:33221/ using document root <none> and password file <none>
I20260807 18:47:25.217331 32056 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:25.217437 32056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:25.217691 32056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:25.220095 32056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d"
format_stamp: "Formatted at 2026-08-07 18:47:25 on dist-test-slave-07c2"
server_key: "71dc6c01ebd4f7ba1c75a33dfedc2a15"
server_key_iv: "ce078519ec4a72fe4be242995bb3f4f0"
server_key_version: "encryptionkey@0"
I20260807 18:47:25.220726 32056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d"
format_stamp: "Formatted at 2026-08-07 18:47:25 on dist-test-slave-07c2"
server_key: "71dc6c01ebd4f7ba1c75a33dfedc2a15"
server_key_iv: "ce078519ec4a72fe4be242995bb3f4f0"
server_key_version: "encryptionkey@0"
I20260807 18:47:25.224939 32056 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:47:25.227595 32071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:25.228916 32056 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:25.229067 32056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d"
format_stamp: "Formatted at 2026-08-07 18:47:25 on dist-test-slave-07c2"
server_key: "71dc6c01ebd4f7ba1c75a33dfedc2a15"
server_key_iv: "ce078519ec4a72fe4be242995bb3f4f0"
server_key_version: "encryptionkey@0"
I20260807 18:47:25.229190 32056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:25.243067 32056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:25.246197 32056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:25.246420 32056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:25.254380 32056 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40349
I20260807 18:47:25.254408 32127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40349 every 8 connection(s)
I20260807 18:47:25.255483 32056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:25.258280 32128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:25.261901 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32056
I20260807 18:47:25.262058 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:25.262395 10939 external_mini_cluster.cc:1428] Setting key 5bf6462bc1fedd90365f8917d4f6003f
I20260807 18:47:25.264611 32128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d: Bootstrap starting.
I20260807 18:47:25.266858 32128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:25.267725 32128 log.cc:824] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:25.270212 32128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d: No bootstrap required, opened a new log
I20260807 18:47:25.272881 32131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:25.263952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44399 (local address 127.0.0.1:40349)
0807 18:47:25.264426 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:25.264442 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:25.264478 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:47:25.265196 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:25.265214 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:25.265567 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:25.265917 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:25.266343 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:25.267451 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:25.268584 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:25.269264 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:25.269439 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:25.270378 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:25.270385 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:25.270403 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:25.270938 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:25.271012 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:25.271043 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:25.271188 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:25.271461 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 18:47:25.271602 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":144,"threads_started":1}
I20260807 18:47:25.274412 32128 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40349 } }
I20260807 18:47:25.274644 32128 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:25.274709 32128 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0060eca8b2a489c9f4ed2b3fd0c633d, State: Initialized, Role: FOLLOWER
I20260807 18:47:25.275171 32128 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40349 } }
I20260807 18:47:25.275357 32128 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:25.275432 32128 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:25.275553 32128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:25.276023 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:25.276619 32128 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40349 } }
I20260807 18:47:25.276970 32128 leader_election.cc:302] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0060eca8b2a489c9f4ed2b3fd0c633d; no voters:
I20260807 18:47:25.277309 32128 leader_election.cc:288] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:25.277392 32134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:25.277602 32134 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [term 1 LEADER]: Becoming Leader. State: Replica: a0060eca8b2a489c9f4ed2b3fd0c633d, State: Running, Role: LEADER
I20260807 18:47:25.278052 32134 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40349 } }
I20260807 18:47:25.278717 32128 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:25.279348 32134 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40349 } } }
I20260807 18:47:25.279521 32134 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:25.279767 32138 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0060eca8b2a489c9f4ed2b3fd0c633d. Latest consensus state: current_term: 1 leader_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0060eca8b2a489c9f4ed2b3fd0c633d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40349 } } }
I20260807 18:47:25.279881 32138 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:25.280073 32142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:25.283378 32131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:25.278206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43059 (local address 127.0.0.1:40349)
0807 18:47:25.278332 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:25.278337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:25.278616 (+ 279us) server_negotiation.cc:407] Connection header received
0807 18:47:25.278804 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:25.278810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:25.278862 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:25.278949 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:25.279276 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:25.280136 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:25.281316 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:25.281655 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:25.281733 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:25.282838 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:25.282842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:25.282845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:25.282862 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:25.282886 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:25.282896 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:25.282991 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:25.283147 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 18:47:25.283185 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 18:47:25.283618 32142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:25.289932 32142 catalog_manager.cc:1347] Generated new cluster ID: 25e236cc9948423fa127735de5fc41e2
I20260807 18:47:25.290011 32142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:25.298292 32142 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:25.299384 32142 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:25.303555 32142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0060eca8b2a489c9f4ed2b3fd0c633d: Generated new TSK 0
I20260807 18:47:25.304230 32142 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:25.309486 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32056
W20260807 18:47:25.316262 32040 connection.cc:535] client connection to 127.0.0.1:40349 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40349): Connection reset by peer (error 104)
2026-08-07T18:47:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:25 dist-test-slave-07c2 krb5kdc[32160](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:25 dist-test-slave-07c2 krb5kdc[32160](info): set up 2 sockets
Aug 07 18:47:25 dist-test-slave-07c2 krb5kdc[32160](info): commencing operation
krb5kdc: starting...
W20260807 18:47:26.362459 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:26 dist-test-slave-07c2 krb5kdc[32160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:26.490973 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42149
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:26.606950 32173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:26.607213 32173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:26.607255 32173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:26.611279 32173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:26.611395 32173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:26.611449 32173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:26.611486 32173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:26.611526 32173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:26.616734 32173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42149
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:26.617734 32173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:26.618716 32173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:26.626801 32181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:26.626940 32173 server_base.cc:1034] running on GCE node
W20260807 18:47:26.626813 32179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:26.626811 32178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:26.627724 32173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:26.628741 32173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:26.629930 32173 hybrid_clock.cc:648] HybridClock initialized: now 1786128446629905 us; error 38 us; skew 500 ppm
Aug 07 18:47:26 dist-test-slave-07c2 krb5kdc[32160](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128446, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:26.632661 32173 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:26.633411 32173 webserver.cc:460] Webserver started at http://127.0.0.1:43955/ using document root <none> and password file <none>
I20260807 18:47:26.633877 32173 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:26.633931 32173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:26.634083 32173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:26.635998 32173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "83e2f5ef712947939d9c053a5ee33f27"
format_stamp: "Formatted at 2026-08-07 18:47:26 on dist-test-slave-07c2"
server_key: "d846b463b6cdf4333a9e8c4551f90678"
server_key_iv: "1f4827a46d2fdc9d703cd71c3817e012"
server_key_version: "encryptionkey@0"
I20260807 18:47:26.636487 32173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "83e2f5ef712947939d9c053a5ee33f27"
format_stamp: "Formatted at 2026-08-07 18:47:26 on dist-test-slave-07c2"
server_key: "d846b463b6cdf4333a9e8c4551f90678"
server_key_iv: "1f4827a46d2fdc9d703cd71c3817e012"
server_key_version: "encryptionkey@0"
I20260807 18:47:26.639854 32173 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 18:47:26.642047 32188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:26.643232 32173 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:26.643388 32173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "83e2f5ef712947939d9c053a5ee33f27"
format_stamp: "Formatted at 2026-08-07 18:47:26 on dist-test-slave-07c2"
server_key: "d846b463b6cdf4333a9e8c4551f90678"
server_key_iv: "1f4827a46d2fdc9d703cd71c3817e012"
server_key_version: "encryptionkey@0"
I20260807 18:47:26.643471 32173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:26.647547 32173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:26.656059 32173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:26.656203 32173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:26.663004 32173 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42149
I20260807 18:47:26.663031 32243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42149 every 8 connection(s)
I20260807 18:47:26.663975 32173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:26.666638 32244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:26.668069 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32173
I20260807 18:47:26.668224 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:26.668598 10939 external_mini_cluster.cc:1428] Setting key f26c9e499ce7de1910b4a66f7bd32c52
I20260807 18:47:26.673319 32244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27: Bootstrap starting.
I20260807 18:47:26.673741 32247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:26.669933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42807 (local address 127.0.0.1:42149)
0807 18:47:26.670340 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:26.670355 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:26.670391 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:47:26.670994 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:26.671009 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:26.671331 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:26.671622 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:26.672487 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:26.672491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:26.672502 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:26.672511 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:26.672563 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:26.672580 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:26.672690 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:26.672817 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 18:47:26.672983 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":136,"threads_started":1}
I20260807 18:47:26.675637 32244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:26.676451 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:26.676426 32244 log.cc:824] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:26.678380 32244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27: No bootstrap required, opened a new log
I20260807 18:47:26.680121 32247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:26.678522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55249 (local address 127.0.0.1:42149)
0807 18:47:26.678651 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:26.678656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:26.678808 (+ 152us) server_negotiation.cc:407] Connection header received
0807 18:47:26.678887 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:26.678890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:26.678922 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:26.679007 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:26.679743 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:26.679746 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:26.679748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:26.679760 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:26.679787 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:26.679800 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:26.679891 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:26.679968 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 18:47:26.680004 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 18:47:26.682765 32244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e2f5ef712947939d9c053a5ee33f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260807 18:47:26.682982 32244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:26.683015 32244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83e2f5ef712947939d9c053a5ee33f27, State: Initialized, Role: FOLLOWER
I20260807 18:47:26.683458 32244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e2f5ef712947939d9c053a5ee33f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260807 18:47:26.683586 32244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:26.683632 32244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:26.683704 32244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:26.684549 32244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e2f5ef712947939d9c053a5ee33f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260807 18:47:26.684849 32244 leader_election.cc:302] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83e2f5ef712947939d9c053a5ee33f27; no voters:
I20260807 18:47:26.685099 32244 leader_election.cc:288] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:26.685225 32254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:26.685449 32254 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [term 1 LEADER]: Becoming Leader. State: Replica: 83e2f5ef712947939d9c053a5ee33f27, State: Running, Role: LEADER
I20260807 18:47:26.685735 32254 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e2f5ef712947939d9c053a5ee33f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } }
I20260807 18:47:26.686313 32244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:26.686849 32254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e2f5ef712947939d9c053a5ee33f27. Latest consensus state: current_term: 1 leader_uuid: "83e2f5ef712947939d9c053a5ee33f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e2f5ef712947939d9c053a5ee33f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } } }
I20260807 18:47:26.687077 32254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:26.687309 32256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83e2f5ef712947939d9c053a5ee33f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e2f5ef712947939d9c053a5ee33f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42149 } } }
I20260807 18:47:26.687409 32256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:26.688035 32262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:26.690721 32262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:26.696173 32262 catalog_manager.cc:1347] Generated new cluster ID: 8da519599cd14515bc97728beaaffa1c
I20260807 18:47:26.696260 32262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:26.707806 32262 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:26.708142 32262 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:26.724749 32262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83e2f5ef712947939d9c053a5ee33f27: Generated new TSK 0
I20260807 18:47:26.725553 32262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:26.731041 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32173
2026-08-07T18:47:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:26 dist-test-slave-07c2 krb5kdc[32276](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:26 dist-test-slave-07c2 krb5kdc[32276](info): set up 2 sockets
Aug 07 18:47:26 dist-test-slave-07c2 krb5kdc[32276](info): commencing operation
krb5kdc: starting...
W20260807 18:47:27.790360 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:27 dist-test-slave-07c2 krb5kdc[32276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:27.920336 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42067
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:28.032827 32289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:28.033095 32289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:28.033138 32289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:28.037177 32289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:28.037246 32289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:28.037266 32289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:28.037286 32289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:28.037339 32289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:28.042590 32289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:28.043874 32289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:28.044912 32289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:28.053759 32295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:28.053736 32298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:28.053778 32294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:28.054023 32289 server_base.cc:1034] running on GCE node
I20260807 18:47:28.054697 32289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:28.055914 32289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:28.057102 32289 hybrid_clock.cc:648] HybridClock initialized: now 1786128448057089 us; error 28 us; skew 500 ppm
Aug 07 18:47:28 dist-test-slave-07c2 krb5kdc[32276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128448, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:28.059921 32289 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:28.060794 32289 webserver.cc:460] Webserver started at http://127.0.0.1:36305/ using document root <none> and password file <none>
I20260807 18:47:28.061357 32289 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:28.061445 32289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:28.061671 32289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:28.063807 32289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "645f949e2d9446ba85a9a127fd8c5be8"
format_stamp: "Formatted at 2026-08-07 18:47:28 on dist-test-slave-07c2"
server_key: "c69d134f3eac871c37cc2e1921f3f5dc"
server_key_iv: "78d871435a175fdf111360d4a49c2953"
server_key_version: "encryptionkey@0"
I20260807 18:47:28.064375 32289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "645f949e2d9446ba85a9a127fd8c5be8"
format_stamp: "Formatted at 2026-08-07 18:47:28 on dist-test-slave-07c2"
server_key: "c69d134f3eac871c37cc2e1921f3f5dc"
server_key_iv: "78d871435a175fdf111360d4a49c2953"
server_key_version: "encryptionkey@0"
I20260807 18:47:28.068267 32289 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 18:47:28.070843 32305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:28.072268 32289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:47:28.072409 32289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "645f949e2d9446ba85a9a127fd8c5be8"
format_stamp: "Formatted at 2026-08-07 18:47:28 on dist-test-slave-07c2"
server_key: "c69d134f3eac871c37cc2e1921f3f5dc"
server_key_iv: "78d871435a175fdf111360d4a49c2953"
server_key_version: "encryptionkey@0"
I20260807 18:47:28.072532 32289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:28.086963 32289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:28.090278 32289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:28.090471 32289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:28.097507 32289 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42067
I20260807 18:47:28.097527 32357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42067 every 8 connection(s)
I20260807 18:47:28.098423 32289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:28.101125 32358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:28.106961 32358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8: Bootstrap starting.
I20260807 18:47:28.107856 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32289
I20260807 18:47:28.108019 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:28.108386 10939 external_mini_cluster.cc:1428] Setting key ecb739651486ad361de604330bd9dff6
I20260807 18:47:28.110394 32358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:28.111204 32358 log.cc:824] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:28.113245 32358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8: No bootstrap required, opened a new log
Aug 07 18:47:28 dist-test-slave-07c2 krb5kdc[32276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 18:47:28.117137 32358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 18:47:28.117445 32358 raft_consensus.cc:374] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:28.117511 32358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645f949e2d9446ba85a9a127fd8c5be8, State: Initialized, Role: FOLLOWER
I20260807 18:47:28.118094 32358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 18:47:28.118362 32363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 18:47:28.118532 32363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 18:47:28.118287 32358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:28.118916 32363 leader_election.cc:302] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 645f949e2d9446ba85a9a127fd8c5be8; no voters:
I20260807 18:47:28.119004 32358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:28.119109 32358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:28.119269 32363 leader_election.cc:288] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260807 18:47:28.120168 32358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 18:47:28.120313 32358 leader_election.cc:302] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 645f949e2d9446ba85a9a127fd8c5be8; no voters:
I20260807 18:47:28.120352 32363 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 18:47:28.120441 32358 leader_election.cc:288] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:28.120615 32363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:28.120698 32363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [term 1 LEADER]: Becoming Leader. State: Replica: 645f949e2d9446ba85a9a127fd8c5be8, State: Running, Role: LEADER
I20260807 18:47:28.120959 32363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 18:47:28.121744 32358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:28.121991 32363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "645f949e2d9446ba85a9a127fd8c5be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } } }
I20260807 18:47:28.122160 32363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:28.122413 32363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 645f949e2d9446ba85a9a127fd8c5be8. Latest consensus state: current_term: 1 leader_uuid: "645f949e2d9446ba85a9a127fd8c5be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645f949e2d9446ba85a9a127fd8c5be8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } } }
I20260807 18:47:28.122560 32363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:28.122944 32368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:28.124329 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:28.109808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53981 (local address 127.0.0.1:42067)
0807 18:47:28.110281 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:28.110296 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:28.110329 (+ 33us) server_negotiation.cc:407] Connection header received
0807 18:47:28.111022 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:28.111039 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:28.111453 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:28.111783 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:28.112584 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:28.113601 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:28.114472 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:28.114931 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:28.115099 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:28.117996 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:28.118002 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:28.118017 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:28.118049 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:28.120199 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:28.120846 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:28.120852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:28.120858 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:28.120997 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:28.121330 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:28.121332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:28.121334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:28.121834 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:28.122636 (+ 802us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:28.122832 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 18:47:28.123176 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":163,"threads_started":1}
I20260807 18:47:28.126425 32368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:28.128064 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:28.133199 32368 catalog_manager.cc:1347] Generated new cluster ID: 208e9491156243628eb24c0054c2b923
I20260807 18:47:28.133282 32368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:28.140121 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:28.130591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54101 (local address 127.0.0.1:42067)
0807 18:47:28.130703 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:28.130708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:28.131113 (+ 405us) server_negotiation.cc:407] Connection header received
0807 18:47:28.131158 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:28.131163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:28.131212 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:28.131352 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:28.132080 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:28.133197 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:28.134439 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:28.134814 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:28.134933 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:28.136617 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:28.136621 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:28.136624 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:28.136651 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:28.138366 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:28.138836 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:28.138840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:28.138842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:28.138930 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:28.139215 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:28.139218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:28.139220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:28.139470 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:28.139627 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:28.139836 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 18:47:28.139958 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:47:28.157725 32368 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:28.159098 32368 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:28.175763 32368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 645f949e2d9446ba85a9a127fd8c5be8: Generated new TSK 0
I20260807 18:47:28.176595 32368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:28.182960 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32289
2026-08-07T18:47:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:28 dist-test-slave-07c2 krb5kdc[32391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:28 dist-test-slave-07c2 krb5kdc[32391](info): set up 2 sockets
Aug 07 18:47:28 dist-test-slave-07c2 krb5kdc[32391](info): commencing operation
krb5kdc: starting...
W20260807 18:47:29.238638 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:29 dist-test-slave-07c2 krb5kdc[32391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:29.369801 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38503
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:29.484738 32404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:29.485067 32404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:29.485154 32404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:29.489428 32404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:29.489527 32404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:29.489565 32404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:29.489621 32404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:29.489661 32404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:29.495162 32404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:29.496404 32404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:29.497486 32404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:29.506420 32412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:29.506421 32409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:29.506434 32410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:29.506647 32404 server_base.cc:1034] running on GCE node
I20260807 18:47:29.507438 32404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:29.508654 32404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:29.509868 32404 hybrid_clock.cc:648] HybridClock initialized: now 1786128449509844 us; error 47 us; skew 500 ppm
Aug 07 18:47:29 dist-test-slave-07c2 krb5kdc[32391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128449, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:29.512830 32404 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:29.513809 32404 webserver.cc:460] Webserver started at http://127.0.0.1:41367/ using document root <none> and password file <none>
I20260807 18:47:29.514382 32404 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:29.514478 32404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:29.514721 32404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:29.516935 32404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "1bb26db306ae4602a0855c3e7d5dcb92"
format_stamp: "Formatted at 2026-08-07 18:47:29 on dist-test-slave-07c2"
server_key: "651aa44e6743efc389cd8fcf4273643b"
server_key_iv: "85257ba00fac607b744c7c4e2c7f8098"
server_key_version: "encryptionkey@0"
I20260807 18:47:29.517511 32404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "1bb26db306ae4602a0855c3e7d5dcb92"
format_stamp: "Formatted at 2026-08-07 18:47:29 on dist-test-slave-07c2"
server_key: "651aa44e6743efc389cd8fcf4273643b"
server_key_iv: "85257ba00fac607b744c7c4e2c7f8098"
server_key_version: "encryptionkey@0"
I20260807 18:47:29.521674 32404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:47:29.524314 32419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:29.525642 32404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:29.525806 32404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "1bb26db306ae4602a0855c3e7d5dcb92"
format_stamp: "Formatted at 2026-08-07 18:47:29 on dist-test-slave-07c2"
server_key: "651aa44e6743efc389cd8fcf4273643b"
server_key_iv: "85257ba00fac607b744c7c4e2c7f8098"
server_key_version: "encryptionkey@0"
I20260807 18:47:29.525930 32404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:29.557621 32404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:29.560678 32404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:29.560895 32404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:29.567723 32404 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38503
I20260807 18:47:29.567745 32473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38503 every 8 connection(s)
I20260807 18:47:29.568637 32404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:29.571215 32474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:29.576668 32474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92: Bootstrap starting.
I20260807 18:47:29.577730 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32404
I20260807 18:47:29.577877 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:29.578214 10939 external_mini_cluster.cc:1428] Setting key 4f308e644d69c5e9a3e7a5e568594e11
I20260807 18:47:29.579941 32474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:29.580842 32474 log.cc:824] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:29.583122 32474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92: No bootstrap required, opened a new log
I20260807 18:47:29.587553 32474 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38503 } }
I20260807 18:47:29.587833 32474 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:29.587893 32474 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bb26db306ae4602a0855c3e7d5dcb92, State: Initialized, Role: FOLLOWER
I20260807 18:47:29.588348 32474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38503 } }
I20260807 18:47:29.588503 32474 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:29.588589 32474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:29.588692 32474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:29.588739 32477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:29.579401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36585 (local address 127.0.0.1:38503)
0807 18:47:29.580276 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:29.580293 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:29.580336 (+ 43us) server_negotiation.cc:407] Connection header received
0807 18:47:29.581228 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:29.581261 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:29.581713 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:29.582077 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:29.582494 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:29.583944 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:29.584840 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:29.585581 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:29.585769 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:29.586551 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:29.586557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:29.586574 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:29.587098 (+ 524us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:29.587176 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:29.587205 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:29.587326 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:29.587522 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 18:47:29.587730 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":138,"threads_started":1}
I20260807 18:47:29.589638 32474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38503 } }
I20260807 18:47:29.589922 32474 leader_election.cc:302] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bb26db306ae4602a0855c3e7d5dcb92; no voters:
I20260807 18:47:29.590173 32474 leader_election.cc:288] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:29.590276 32479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:29.590782 32479 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [term 1 LEADER]: Becoming Leader. State: Replica: 1bb26db306ae4602a0855c3e7d5dcb92, State: Running, Role: LEADER
I20260807 18:47:29.591144 32479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38503 } }
I20260807 18:47:29.591497 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:29.591513 32474 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:29.592798 32481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bb26db306ae4602a0855c3e7d5dcb92. Latest consensus state: current_term: 1 leader_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38503 } } }
I20260807 18:47:29.592962 32481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:29.593393 32492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:29.593356 32480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb26db306ae4602a0855c3e7d5dcb92" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38503 } } }
I20260807 18:47:29.593504 32480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:29.596932 32492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:29.598107 32477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:29.593791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58973 (local address 127.0.0.1:38503)
0807 18:47:29.594458 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:29.594461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:29.594471 (+ 10us) server_negotiation.cc:407] Connection header received
0807 18:47:29.594500 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:29.594502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:29.594534 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:29.594632 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:29.594893 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:29.595650 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:29.596476 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:29.596721 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:29.596836 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:29.597689 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:29.597693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:29.597696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:29.597708 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:29.597743 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:29.597754 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:29.597832 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:29.597919 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 18:47:29.597970 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602}
I20260807 18:47:29.602414 32492 catalog_manager.cc:1347] Generated new cluster ID: e1aacd4e90714fed810ce17aaf733117
I20260807 18:47:29.602485 32492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:29.615084 32492 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:29.616273 32492 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:29.627977 32492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bb26db306ae4602a0855c3e7d5dcb92: Generated new TSK 0
I20260807 18:47:29.628861 32492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:29.632697 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32404
2026-08-07T18:47:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:29 dist-test-slave-07c2 krb5kdc[32505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:29 dist-test-slave-07c2 krb5kdc[32505](info): set up 2 sockets
Aug 07 18:47:29 dist-test-slave-07c2 krb5kdc[32505](info): commencing operation
krb5kdc: starting...
W20260807 18:47:30.694212 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:30 dist-test-slave-07c2 krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:30.820467 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41313
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:30.931910 32519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:30.932228 32519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:30.932302 32519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:30.936336 32519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:30.936427 32519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:30.936466 32519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:30.936522 32519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:30.936563 32519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:30.941970 32519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:30.943085 32519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:30.944144 32519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:30.952649 32527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:30.952649 32524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:30.952759 32525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:30.953078 32519 server_base.cc:1034] running on GCE node
I20260807 18:47:30.953661 32519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:30.954756 32519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:30.955948 32519 hybrid_clock.cc:648] HybridClock initialized: now 1786128450955929 us; error 31 us; skew 500 ppm
Aug 07 18:47:30 dist-test-slave-07c2 krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128450, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:30.958658 32519 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:30.959618 32519 webserver.cc:460] Webserver started at http://127.0.0.1:38875/ using document root <none> and password file <none>
I20260807 18:47:30.960171 32519 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:30.960263 32519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:30.960493 32519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:30.962492 32519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "fa412f2a0ce2412096b9622f7cfc821b"
format_stamp: "Formatted at 2026-08-07 18:47:30 on dist-test-slave-07c2"
server_key: "51cc115fcf8268edf9bfb04d176e9790"
server_key_iv: "adb611ad416f3a11022f4ca7b830edc1"
server_key_version: "encryptionkey@0"
I20260807 18:47:30.963070 32519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "fa412f2a0ce2412096b9622f7cfc821b"
format_stamp: "Formatted at 2026-08-07 18:47:30 on dist-test-slave-07c2"
server_key: "51cc115fcf8268edf9bfb04d176e9790"
server_key_iv: "adb611ad416f3a11022f4ca7b830edc1"
server_key_version: "encryptionkey@0"
I20260807 18:47:30.966876 32519 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 18:47:30.969301 32534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:30.970461 32519 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 18:47:30.970618 32519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "fa412f2a0ce2412096b9622f7cfc821b"
format_stamp: "Formatted at 2026-08-07 18:47:30 on dist-test-slave-07c2"
server_key: "51cc115fcf8268edf9bfb04d176e9790"
server_key_iv: "adb611ad416f3a11022f4ca7b830edc1"
server_key_version: "encryptionkey@0"
I20260807 18:47:30.970736 32519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:30.975277 32519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:30.978348 32519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:30.978559 32519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:30.985793 32519 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41313
I20260807 18:47:30.985819 32586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41313 every 8 connection(s)
I20260807 18:47:30.986776 32519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:30.989550 32587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:30.995147 32587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b: Bootstrap starting.
I20260807 18:47:30.997006 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32519
I20260807 18:47:30.997174 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:30.997480 10939 external_mini_cluster.cc:1428] Setting key 7be63b75e5a842c7d3959a673d44bdba
I20260807 18:47:30.997964 32587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:30.998835 32587 log.cc:824] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:31.001005 32587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b: No bootstrap required, opened a new log
I20260807 18:47:31.002775 32590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:30.998663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43119 (local address 127.0.0.1:41313)
0807 18:47:30.999162 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:30.999195 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:30.999244 (+ 49us) server_negotiation.cc:407] Connection header received
0807 18:47:31.000086 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:31.000106 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:31.000375 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:31.000716 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:31.001577 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:31.001583 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:31.001602 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:31.001613 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:31.001667 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:31.001687 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:31.001817 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:31.001920 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 18:47:31.002081 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":147,"threads_started":1}
I20260807 18:47:31.005177 32587 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa412f2a0ce2412096b9622f7cfc821b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41313 } }
I20260807 18:47:31.005467 32587 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:31.005527 32587 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa412f2a0ce2412096b9622f7cfc821b, State: Initialized, Role: FOLLOWER
I20260807 18:47:31.005854 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:31.005961 32587 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa412f2a0ce2412096b9622f7cfc821b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41313 } }
I20260807 18:47:31.006136 32587 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:31.006206 32587 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:31.006309 32587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:31.007398 32587 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa412f2a0ce2412096b9622f7cfc821b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41313 } }
I20260807 18:47:31.007740 32587 leader_election.cc:302] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa412f2a0ce2412096b9622f7cfc821b; no voters:
I20260807 18:47:31.008131 32587 leader_election.cc:288] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:31.008311 32596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:31.008560 32596 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [term 1 LEADER]: Becoming Leader. State: Replica: fa412f2a0ce2412096b9622f7cfc821b, State: Running, Role: LEADER
I20260807 18:47:31.008898 32596 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa412f2a0ce2412096b9622f7cfc821b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41313 } }
I20260807 18:47:31.009395 32587 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:31.010684 32598 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa412f2a0ce2412096b9622f7cfc821b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa412f2a0ce2412096b9622f7cfc821b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41313 } } }
I20260807 18:47:31.010695 32599 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa412f2a0ce2412096b9622f7cfc821b. Latest consensus state: current_term: 1 leader_uuid: "fa412f2a0ce2412096b9622f7cfc821b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa412f2a0ce2412096b9622f7cfc821b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41313 } } }
I20260807 18:47:31.010813 32598 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:31.010820 32599 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:31.011169 32607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:31.013273 32590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:31.008103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51289 (local address 127.0.0.1:41313)
0807 18:47:31.008219 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:31.008224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:31.011661 (+ 3437us) server_negotiation.cc:407] Connection header received
0807 18:47:31.011964 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:31.011968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:31.012009 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:31.012102 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:31.012862 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:31.012865 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:31.012868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:31.012880 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:31.012909 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:31.012921 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:31.013008 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:31.013107 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 18:47:31.013148 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 18:47:31.014392 32607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:31.019850 32607 catalog_manager.cc:1347] Generated new cluster ID: b8c10fde78b84119a2d946d1891fb15c
I20260807 18:47:31.019929 32607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:31.031673 32607 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:31.032001 32607 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:31.036731 32607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa412f2a0ce2412096b9622f7cfc821b: Generated new TSK 0
I20260807 18:47:31.037366 32607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:31.042659 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32519
2026-08-07T18:47:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:31 dist-test-slave-07c2 krb5kdc[32619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:31 dist-test-slave-07c2 krb5kdc[32619](info): set up 2 sockets
Aug 07 18:47:31 dist-test-slave-07c2 krb5kdc[32619](info): commencing operation
krb5kdc: starting...
W20260807 18:47:32.106731 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:32 dist-test-slave-07c2 krb5kdc[32619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:32.233930 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43091
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:32.344117 32632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:32.344390 32632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:32.344434 32632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:32.348461 32632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:32.348520 32632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:32.348557 32632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:32.348574 32632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:32.348594 32632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:32.353943 32632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:32.355124 32632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:32.356186 32632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:32.364929 32641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:32.364909 32638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:32.364909 32639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:32.364965 32632 server_base.cc:1034] running on GCE node
I20260807 18:47:32.365813 32632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:32.366912 32632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:32.368105 32632 hybrid_clock.cc:648] HybridClock initialized: now 1786128452368093 us; error 37 us; skew 500 ppm
Aug 07 18:47:32 dist-test-slave-07c2 krb5kdc[32619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128452, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:32.370919 32632 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:32.371888 32632 webserver.cc:460] Webserver started at http://127.0.0.1:36651/ using document root <none> and password file <none>
I20260807 18:47:32.372448 32632 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:32.372537 32632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:32.372767 32632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:32.374800 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "42b5b92472f3428abb3298b9cb171720"
format_stamp: "Formatted at 2026-08-07 18:47:32 on dist-test-slave-07c2"
server_key: "588d15e8b9d83678191f32026e4bfa56"
server_key_iv: "396c6316f1c118b15720c02c9fb8faa9"
server_key_version: "encryptionkey@0"
I20260807 18:47:32.375428 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "42b5b92472f3428abb3298b9cb171720"
format_stamp: "Formatted at 2026-08-07 18:47:32 on dist-test-slave-07c2"
server_key: "588d15e8b9d83678191f32026e4bfa56"
server_key_iv: "396c6316f1c118b15720c02c9fb8faa9"
server_key_version: "encryptionkey@0"
I20260807 18:47:32.379086 32632 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:32.381587 32648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:32.382838 32632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:32.383082 32632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "42b5b92472f3428abb3298b9cb171720"
format_stamp: "Formatted at 2026-08-07 18:47:32 on dist-test-slave-07c2"
server_key: "588d15e8b9d83678191f32026e4bfa56"
server_key_iv: "396c6316f1c118b15720c02c9fb8faa9"
server_key_version: "encryptionkey@0"
I20260807 18:47:32.383203 32632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:32.401834 32632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:32.405140 32632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:32.405376 32632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:32.414085 32632 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43091
I20260807 18:47:32.414129 32701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43091 every 8 connection(s)
I20260807 18:47:32.415131 32632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:32.418141 32702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:32.420833 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32632
I20260807 18:47:32.420994 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:32.421269 10939 external_mini_cluster.cc:1428] Setting key 72a73fc293f21c52333518284461d07c
I20260807 18:47:32.424916 32702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720: Bootstrap starting.
I20260807 18:47:32.427547 32702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:32.428395 32702 log.cc:824] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:32.430538 32702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720: No bootstrap required, opened a new log
Aug 07 18:47:32 dist-test-slave-07c2 krb5kdc[32619](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 18:47:32.434862 32702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b5b92472f3428abb3298b9cb171720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43091 } }
I20260807 18:47:32.435145 32702 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:32.435206 32702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b5b92472f3428abb3298b9cb171720, State: Initialized, Role: FOLLOWER
I20260807 18:47:32.435729 32702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b5b92472f3428abb3298b9cb171720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43091 } }
I20260807 18:47:32.435889 32702 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:32.435958 32702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:32.436056 32702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:32.437222 32702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b5b92472f3428abb3298b9cb171720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43091 } }
I20260807 18:47:32.437618 32702 leader_election.cc:302] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42b5b92472f3428abb3298b9cb171720; no voters:
I20260807 18:47:32.437922 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:32.422688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:49595 (local address 127.0.0.1:43091)
0807 18:47:32.423131 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:32.423151 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:32.423194 (+ 43us) server_negotiation.cc:407] Connection header received
0807 18:47:32.424082 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:32.424142 (+ 60us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:32.424566 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:32.424928 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:32.425676 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:32.427164 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:32.428136 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:32.428852 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:32.428992 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:32.431866 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:32.431873 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:32.431889 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:32.431921 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:32.434545 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:32.435077 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:32.435083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:32.435088 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:32.435247 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:32.435668 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:32.435672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:32.435673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:32.436208 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:32.436442 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:32.436663 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 18:47:32.436901 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":112,"threads_started":1}
I20260807 18:47:32.437973 32702 leader_election.cc:288] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:32.438103 32707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:32.438318 32707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [term 1 LEADER]: Becoming Leader. State: Replica: 42b5b92472f3428abb3298b9cb171720, State: Running, Role: LEADER
I20260807 18:47:32.438632 32707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b5b92472f3428abb3298b9cb171720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43091 } }
I20260807 18:47:32.439254 32702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:32.440712 32708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42b5b92472f3428abb3298b9cb171720. Latest consensus state: current_term: 1 leader_uuid: "42b5b92472f3428abb3298b9cb171720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b5b92472f3428abb3298b9cb171720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43091 } } }
I20260807 18:47:32.440838 32708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:32.441141 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:32.441744 32709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42b5b92472f3428abb3298b9cb171720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b5b92472f3428abb3298b9cb171720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43091 } } }
I20260807 18:47:32.443811 32709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720 [sys.catalog]: This master's current role is: LEADER
W20260807 18:47:32.444324 32722 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:32.444406 32722 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:32.444551 32719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:32.445612 32719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:32.451578 32719 catalog_manager.cc:1347] Generated new cluster ID: 57927b1a2e8e455898eb3bab66c72892
I20260807 18:47:32.451643 32719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:32.453523 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:32.443756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:51135 (local address 127.0.0.1:43091)
0807 18:47:32.443876 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:32.443880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:32.444842 (+ 962us) server_negotiation.cc:407] Connection header received
0807 18:47:32.444981 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:32.444984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:32.445032 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:32.445122 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:32.445960 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:32.446752 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:32.447765 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:32.447999 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:32.448111 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:32.449642 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:32.449646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:32.449649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:32.449675 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:32.451458 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:32.452164 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:32.452168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:32.452170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:32.452260 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:32.452633 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:32.452636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:32.452638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:32.452839 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:32.452976 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:32.453286 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 18:47:32.453383 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:47:32.470548 32719 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:32.471830 32719 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:32.484432 32719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42b5b92472f3428abb3298b9cb171720: Generated new TSK 0
I20260807 18:47:32.485268 32719 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:32.499653 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32632
W20260807 18:47:32.506616 32617 connection.cc:535] client connection to 127.0.0.1:43091 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43091): Connection reset by peer (error 104)
2026-08-07T18:47:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:32 dist-test-slave-07c2 krb5kdc[32733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:32 dist-test-slave-07c2 krb5kdc[32733](info): set up 2 sockets
Aug 07 18:47:32 dist-test-slave-07c2 krb5kdc[32733](info): commencing operation
krb5kdc: starting...
W20260807 18:47:33.566470 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:33 dist-test-slave-07c2 krb5kdc[32733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:33.696431 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42973
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:33.806581 32746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:33.806843 32746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:33.806885 32746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:33.811753 32746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:33.811820 32746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:33.811839 32746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:33.811856 32746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:33.811906 32746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:33.817176 32746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42973
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:33.818210 32746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:33.819222 32746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:33.827442 32753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:33.827473 32752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:33.827611 32746 server_base.cc:1034] running on GCE node
W20260807 18:47:33.827476 32755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:33.828238 32746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:33.829320 32746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:33.830514 32746 hybrid_clock.cc:648] HybridClock initialized: now 1786128453830502 us; error 25 us; skew 500 ppm
Aug 07 18:47:33 dist-test-slave-07c2 krb5kdc[32733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128453, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:33.833302 32746 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:33.834187 32746 webserver.cc:460] Webserver started at http://127.0.0.1:34345/ using document root <none> and password file <none>
I20260807 18:47:33.834726 32746 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:33.834831 32746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:33.835062 32746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:33.837109 32746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "3ca2bcb965e649288b0b5143fc355279"
format_stamp: "Formatted at 2026-08-07 18:47:33 on dist-test-slave-07c2"
server_key: "5609f876243db515eba71da9d4679032"
server_key_iv: "6018daac5a7c65955faf13769a142797"
server_key_version: "encryptionkey@0"
I20260807 18:47:33.837683 32746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "3ca2bcb965e649288b0b5143fc355279"
format_stamp: "Formatted at 2026-08-07 18:47:33 on dist-test-slave-07c2"
server_key: "5609f876243db515eba71da9d4679032"
server_key_iv: "6018daac5a7c65955faf13769a142797"
server_key_version: "encryptionkey@0"
I20260807 18:47:33.841298 32746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260807 18:47:33.843611 32762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:33.844735 32746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 18:47:33.844885 32746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "3ca2bcb965e649288b0b5143fc355279"
format_stamp: "Formatted at 2026-08-07 18:47:33 on dist-test-slave-07c2"
server_key: "5609f876243db515eba71da9d4679032"
server_key_iv: "6018daac5a7c65955faf13769a142797"
server_key_version: "encryptionkey@0"
I20260807 18:47:33.845000 32746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:33.868373 32746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:33.871438 32746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:33.871660 32746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:33.879204 32746 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42973
I20260807 18:47:33.879235 347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42973 every 8 connection(s)
I20260807 18:47:33.880266 32746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:33.882961 348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:33.883277 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 32746
I20260807 18:47:33.883455 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:33.883752 10939 external_mini_cluster.cc:1428] Setting key 7c23d25c0e179f3fc18d3783fe4dba18
I20260807 18:47:33.889688 348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279: Bootstrap starting.
I20260807 18:47:33.892141 348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:33.892985 348 log.cc:824] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:33.893083 351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:33.885254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:50537 (local address 127.0.0.1:42973)
0807 18:47:33.885707 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:33.885722 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:33.885758 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:47:33.886441 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:33.886458 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:33.886802 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:33.887150 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:33.887599 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:33.888589 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:33.889531 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:33.890086 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:33.890261 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:33.891246 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:33.891251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:33.891263 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:33.891718 (+ 455us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:33.891777 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:33.891807 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:33.891960 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:33.892151 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 18:47:33.892315 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":139,"threads_started":1}
I20260807 18:47:33.895208 348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279: No bootstrap required, opened a new log
I20260807 18:47:33.896246 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:33.900206 348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca2bcb965e649288b0b5143fc355279" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260807 18:47:33.900517 348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:33.900597 348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ca2bcb965e649288b0b5143fc355279, State: Initialized, Role: FOLLOWER
I20260807 18:47:33.901037 348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca2bcb965e649288b0b5143fc355279" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260807 18:47:33.901178 348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:33.901260 348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:33.901360 348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:33.902680 348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca2bcb965e649288b0b5143fc355279" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260807 18:47:33.903013 351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:33.898615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:36535 (local address 127.0.0.1:42973)
0807 18:47:33.898780 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:33.898785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:33.898921 (+ 136us) server_negotiation.cc:407] Connection header received
0807 18:47:33.899007 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:33.899010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:33.899062 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:33.899147 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:33.899426 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:33.900184 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:33.901217 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:33.901612 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:33.901726 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:33.902552 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:33.902559 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:33.902565 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:33.902581 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:33.902611 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:33.902629 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:33.902729 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:33.902849 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 18:47:33.902885 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 18:47:33.903059 348 leader_election.cc:302] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ca2bcb965e649288b0b5143fc355279; no voters:
I20260807 18:47:33.903427 348 leader_election.cc:288] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:33.903534 359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:33.903776 359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [term 1 LEADER]: Becoming Leader. State: Replica: 3ca2bcb965e649288b0b5143fc355279, State: Running, Role: LEADER
I20260807 18:47:33.904165 359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca2bcb965e649288b0b5143fc355279" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } }
I20260807 18:47:33.904767 348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:33.906031 361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ca2bcb965e649288b0b5143fc355279. Latest consensus state: current_term: 1 leader_uuid: "3ca2bcb965e649288b0b5143fc355279" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca2bcb965e649288b0b5143fc355279" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } } }
I20260807 18:47:33.906167 361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:33.906582 368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:33.907228 360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ca2bcb965e649288b0b5143fc355279" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ca2bcb965e649288b0b5143fc355279" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42973 } } }
I20260807 18:47:33.907496 360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:33.909998 368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:33.915411 368 catalog_manager.cc:1347] Generated new cluster ID: b104663927d04482a32ac32e78707cdd
I20260807 18:47:33.915495 368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:33.923995 368 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:33.925288 368 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:33.937399 368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ca2bcb965e649288b0b5143fc355279: Generated new TSK 0
I20260807 18:47:33.938264 368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:33.942430 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 32746
W20260807 18:47:33.949666 32731 connection.cc:535] client connection to 127.0.0.1:42973 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42973): Connection reset by peer (error 104)
2026-08-07T18:47:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:34 dist-test-slave-07c2 krb5kdc[380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:34 dist-test-slave-07c2 krb5kdc[380](info): set up 2 sockets
Aug 07 18:47:34 dist-test-slave-07c2 krb5kdc[380](info): commencing operation
krb5kdc: starting...
W20260807 18:47:35.012481 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:35 dist-test-slave-07c2 krb5kdc[380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:35.135670 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43885
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:35.245680 393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:35.245908 393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:35.245946 393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:35.249920 393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:35.249974 393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:35.249993 393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:35.250052 393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:35.250082 393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:35.255079 393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:35.256074 393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:35.257036 393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:35.265199 398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:35.265202 399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:35.265187 401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:35.265458 393 server_base.cc:1034] running on GCE node
I20260807 18:47:35.266000 393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:35.267050 393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:35.268235 393 hybrid_clock.cc:648] HybridClock initialized: now 1786128455268215 us; error 37 us; skew 500 ppm
Aug 07 18:47:35 dist-test-slave-07c2 krb5kdc[380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128455, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:35.270867 393 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:35.271701 393 webserver.cc:460] Webserver started at http://127.0.0.1:45531/ using document root <none> and password file <none>
I20260807 18:47:35.272184 393 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:35.272241 393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:35.272396 393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:35.274271 393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "b6b49a87df4542b0932706cfb00401b9"
format_stamp: "Formatted at 2026-08-07 18:47:35 on dist-test-slave-07c2"
server_key: "a75e8aa0c075a4552f2e1084e478c958"
server_key_iv: "3535e35d84d4d912430b3066a6c6fcdb"
server_key_version: "encryptionkey@0"
I20260807 18:47:35.274770 393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "b6b49a87df4542b0932706cfb00401b9"
format_stamp: "Formatted at 2026-08-07 18:47:35 on dist-test-slave-07c2"
server_key: "a75e8aa0c075a4552f2e1084e478c958"
server_key_iv: "3535e35d84d4d912430b3066a6c6fcdb"
server_key_version: "encryptionkey@0"
I20260807 18:47:35.278338 393 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 18:47:35.280674 408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:35.281891 393 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:35.281989 393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "b6b49a87df4542b0932706cfb00401b9"
format_stamp: "Formatted at 2026-08-07 18:47:35 on dist-test-slave-07c2"
server_key: "a75e8aa0c075a4552f2e1084e478c958"
server_key_iv: "3535e35d84d4d912430b3066a6c6fcdb"
server_key_version: "encryptionkey@0"
I20260807 18:47:35.282073 393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:35.286612 393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:35.289490 393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:35.289633 393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:35.296118 393 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43885
I20260807 18:47:35.296176 462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43885 every 8 connection(s)
I20260807 18:47:35.297024 393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:35.300015 463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:35.301402 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 393
I20260807 18:47:35.301541 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:35.301832 10939 external_mini_cluster.cc:1428] Setting key 8d74a08aea5f8e7f05043aaece52e372
I20260807 18:47:35.306874 463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9: Bootstrap starting.
I20260807 18:47:35.307067 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:35.303064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:44173 (local address 127.0.0.1:43885)
0807 18:47:35.303493 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:35.303515 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:35.303561 (+ 46us) server_negotiation.cc:407] Connection header received
0807 18:47:35.304370 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:35.304392 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:35.304729 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:35.305092 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:35.305742 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:35.305747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:35.305762 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:35.305774 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:35.305835 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:35.305863 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:35.306006 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:35.306081 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 18:47:35.306225 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":109,"threads_started":1}
I20260807 18:47:35.309450 463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:35.309754 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:35.310218 463 log.cc:824] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:35.312391 463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9: No bootstrap required, opened a new log
I20260807 18:47:35.313663 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:35.311980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:52889 (local address 127.0.0.1:43885)
0807 18:47:35.312109 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:35.312113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:35.312334 (+ 221us) server_negotiation.cc:407] Connection header received
0807 18:47:35.312481 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:35.312484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:35.312525 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:35.312590 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:35.313277 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:35.313280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:35.313283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:35.313293 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:35.313316 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:35.313326 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:35.313396 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:35.313505 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 18:47:35.313535 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 18:47:35.316399 463 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6b49a87df4542b0932706cfb00401b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43885 } }
I20260807 18:47:35.316644 463 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:35.316708 463 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6b49a87df4542b0932706cfb00401b9, State: Initialized, Role: FOLLOWER
I20260807 18:47:35.317162 463 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6b49a87df4542b0932706cfb00401b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43885 } }
I20260807 18:47:35.317310 463 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:35.317378 463 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:35.317483 463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:35.318549 463 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6b49a87df4542b0932706cfb00401b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43885 } }
I20260807 18:47:35.318871 463 leader_election.cc:302] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6b49a87df4542b0932706cfb00401b9; no voters:
I20260807 18:47:35.319162 463 leader_election.cc:288] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:35.319317 473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:35.319581 473 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [term 1 LEADER]: Becoming Leader. State: Replica: b6b49a87df4542b0932706cfb00401b9, State: Running, Role: LEADER
I20260807 18:47:35.319916 473 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6b49a87df4542b0932706cfb00401b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43885 } }
I20260807 18:47:35.320340 463 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:35.321496 475 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6b49a87df4542b0932706cfb00401b9. Latest consensus state: current_term: 1 leader_uuid: "b6b49a87df4542b0932706cfb00401b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6b49a87df4542b0932706cfb00401b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43885 } } }
I20260807 18:47:35.321622 475 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:35.321805 474 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6b49a87df4542b0932706cfb00401b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6b49a87df4542b0932706cfb00401b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43885 } } }
I20260807 18:47:35.322057 474 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9 [sys.catalog]: This master's current role is: LEADER
W20260807 18:47:35.324875 489 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:35.324975 489 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:35.325052 485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:35.325726 485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:35.330955 485 catalog_manager.cc:1347] Generated new cluster ID: aebc2c540f404cabaeb9e8ad0ed05d09
I20260807 18:47:35.331017 485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:35.342972 485 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:35.343308 485 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:35.350118 485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6b49a87df4542b0932706cfb00401b9: Generated new TSK 0
I20260807 18:47:35.350860 485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:35.361465 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 393
2026-08-07T18:47:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1418 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:35 dist-test-slave-07c2 krb5kdc[495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:35 dist-test-slave-07c2 krb5kdc[495](info): set up 2 sockets
Aug 07 18:47:35 dist-test-slave-07c2 krb5kdc[495](info): commencing operation
krb5kdc: starting...
W20260807 18:47:36.422609 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:36 dist-test-slave-07c2 krb5kdc[495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:36.548316 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:36.660094 510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:36.660353 510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:36.660423 510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:36.664287 510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:36.664364 510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:36.664402 510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:36.664443 510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:36.664474 510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:36.669548 510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38175
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:36.670737 510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:36.671780 510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:36.679694 518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:36.679700 516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:36.679839 510 server_base.cc:1034] running on GCE node
W20260807 18:47:36.680014 515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:36.680576 510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:36.681559 510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:36.682721 510 hybrid_clock.cc:648] HybridClock initialized: now 1786128456682705 us; error 30 us; skew 500 ppm
Aug 07 18:47:36 dist-test-slave-07c2 krb5kdc[495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128456, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:36.685434 510 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:36.686280 510 webserver.cc:460] Webserver started at http://127.0.0.1:35477/ using document root <none> and password file <none>
I20260807 18:47:36.686777 510 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:36.686833 510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:36.686990 510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:36.688978 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "d15d8690ca474367afee897d620df361"
format_stamp: "Formatted at 2026-08-07 18:47:36 on dist-test-slave-07c2"
server_key: "7bb8e458483f06525ae5a1ae3c780a1a"
server_key_iv: "377d3905834b1933adcbaa428f236d34"
server_key_version: "encryptionkey@0"
I20260807 18:47:36.689487 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "d15d8690ca474367afee897d620df361"
format_stamp: "Formatted at 2026-08-07 18:47:36 on dist-test-slave-07c2"
server_key: "7bb8e458483f06525ae5a1ae3c780a1a"
server_key_iv: "377d3905834b1933adcbaa428f236d34"
server_key_version: "encryptionkey@0"
I20260807 18:47:36.693147 510 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:47:36.695448 525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:36.696611 510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:36.696768 510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "d15d8690ca474367afee897d620df361"
format_stamp: "Formatted at 2026-08-07 18:47:36 on dist-test-slave-07c2"
server_key: "7bb8e458483f06525ae5a1ae3c780a1a"
server_key_iv: "377d3905834b1933adcbaa428f236d34"
server_key_version: "encryptionkey@0"
I20260807 18:47:36.696884 510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:36.715562 510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:36.718402 510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:36.718626 510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:36.726122 510 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38175
I20260807 18:47:36.726145 577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38175 every 8 connection(s)
I20260807 18:47:36.727093 510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:36.729766 578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:36.734455 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 510
I20260807 18:47:36.734613 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:36.734927 10939 external_mini_cluster.cc:1428] Setting key 5192ce7262152c7870cf8b8416522030
I20260807 18:47:36.735419 578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361: Bootstrap starting.
I20260807 18:47:36.737766 578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:36.738483 578 log.cc:824] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:36.740793 578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361: No bootstrap required, opened a new log
Aug 07 18:47:36 dist-test-slave-07c2 krb5kdc[495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 18:47:36.744906 578 raft_consensus.cc:348] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d15d8690ca474367afee897d620df361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38175 } }
I20260807 18:47:36.745123 578 raft_consensus.cc:374] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:36.745180 578 raft_consensus.cc:729] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15d8690ca474367afee897d620df361, State: Initialized, Role: FOLLOWER
I20260807 18:47:36.745713 578 consensus_queue.cc:260] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d15d8690ca474367afee897d620df361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38175 } }
I20260807 18:47:36.745878 578 raft_consensus.cc:388] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:36.745967 578 raft_consensus.cc:482] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:36.746083 578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:36.747304 578 raft_consensus.cc:504] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d15d8690ca474367afee897d620df361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38175 } }
I20260807 18:47:36.747673 578 leader_election.cc:302] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d15d8690ca474367afee897d620df361; no voters:
I20260807 18:47:36.748034 578 leader_election.cc:288] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:36.748127 583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:36.748427 583 raft_consensus.cc:686] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [term 1 LEADER]: Becoming Leader. State: Replica: d15d8690ca474367afee897d620df361, State: Running, Role: LEADER
I20260807 18:47:36.748751 583 consensus_queue.cc:237] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d15d8690ca474367afee897d620df361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38175 } }
I20260807 18:47:36.749444 578 sys_catalog.cc:564] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:36.750448 585 sys_catalog.cc:455] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d15d8690ca474367afee897d620df361. Latest consensus state: current_term: 1 leader_uuid: "d15d8690ca474367afee897d620df361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d15d8690ca474367afee897d620df361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38175 } } }
I20260807 18:47:36.750588 585 sys_catalog.cc:458] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:36.750448 584 sys_catalog.cc:455] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d15d8690ca474367afee897d620df361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d15d8690ca474367afee897d620df361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38175 } } }
I20260807 18:47:36.750933 584 sys_catalog.cc:458] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:36.750993 593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:36.752081 581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:36.736339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:44225 (local address 127.0.0.1:38175)
0807 18:47:36.736844 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:36.736860 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:36.736895 (+ 35us) server_negotiation.cc:407] Connection header received
0807 18:47:36.737493 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:36.737508 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:36.737881 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:36.738233 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:36.739118 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:36.740590 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:36.741587 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:36.742256 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:36.742427 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:36.745449 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:36.745454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:36.745469 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:36.745499 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:36.747655 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:36.748359 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:36.748365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:36.748371 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:36.748592 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:36.749067 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:36.749070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:36.749072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:36.749557 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:36.750540 (+ 983us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:36.750737 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 18:47:36.750968 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":169,"threads_started":1}
I20260807 18:47:36.754907 593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:36.755321 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:36.761206 593 catalog_manager.cc:1347] Generated new cluster ID: 4570cb82b713486593117499e98b73f7
I20260807 18:47:36.761301 593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:36.765923 581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:36.757338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:45051 (local address 127.0.0.1:38175)
0807 18:47:36.757433 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:36.757437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:36.757715 (+ 278us) server_negotiation.cc:407] Connection header received
0807 18:47:36.757830 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:36.757832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:36.757878 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:36.757958 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:36.758772 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:36.759476 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:36.760273 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:36.760526 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:36.760646 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:36.762309 (+ 1663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:36.762315 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:36.762319 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:36.762347 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:36.764049 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:36.764551 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:36.764555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:36.764557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:36.764645 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:36.765019 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:36.765023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:36.765025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:36.765237 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:36.765413 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:36.765667 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 18:47:36.765765 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 18:47:36.789685 593 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:36.790890 593 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:36.798038 593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d15d8690ca474367afee897d620df361: Generated new TSK 0
I20260807 18:47:36.798743 593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:36.803118 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 510
W20260807 18:47:36.810329 493 connection.cc:535] client connection to 127.0.0.1:38175 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38175): Connection reset by peer (error 104)
2026-08-07T18:47:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:36 dist-test-slave-07c2 krb5kdc[610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:36 dist-test-slave-07c2 krb5kdc[610](info): set up 2 sockets
Aug 07 18:47:36 dist-test-slave-07c2 krb5kdc[610](info): commencing operation
krb5kdc: starting...
W20260807 18:47:37.862872 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:37 dist-test-slave-07c2 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:37.999189 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40645
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:38.115180 623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:38.115646 623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:38.115770 623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:38.119973 623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:38.120090 623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:38.120127 623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:38.120169 623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:38.120203 623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:38.125834 623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40645
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:38.126994 623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:38.128118 623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:38.136974 628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:38.136978 631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:38.136998 629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:38.137470 623 server_base.cc:1034] running on GCE node
I20260807 18:47:38.138127 623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:38.139276 623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:38.140503 623 hybrid_clock.cc:648] HybridClock initialized: now 1786128458140473 us; error 48 us; skew 500 ppm
Aug 07 18:47:38 dist-test-slave-07c2 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128458, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:38.149484 623 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:38.150473 623 webserver.cc:460] Webserver started at http://127.0.0.1:40203/ using document root <none> and password file <none>
I20260807 18:47:38.151027 623 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:38.151093 623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:38.151268 623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:38.153484 623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "9beb2d8d8ac34671946a1315076eab56"
format_stamp: "Formatted at 2026-08-07 18:47:38 on dist-test-slave-07c2"
server_key: "12241adb90269802868061bfbe4396b7"
server_key_iv: "dc12e299ca6006b03be9346f4402d156"
server_key_version: "encryptionkey@0"
I20260807 18:47:38.154098 623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "9beb2d8d8ac34671946a1315076eab56"
format_stamp: "Formatted at 2026-08-07 18:47:38 on dist-test-slave-07c2"
server_key: "12241adb90269802868061bfbe4396b7"
server_key_iv: "dc12e299ca6006b03be9346f4402d156"
server_key_version: "encryptionkey@0"
I20260807 18:47:38.158159 623 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:47:38.160670 638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:38.161963 623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:38.162110 623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "9beb2d8d8ac34671946a1315076eab56"
format_stamp: "Formatted at 2026-08-07 18:47:38 on dist-test-slave-07c2"
server_key: "12241adb90269802868061bfbe4396b7"
server_key_iv: "dc12e299ca6006b03be9346f4402d156"
server_key_version: "encryptionkey@0"
I20260807 18:47:38.162230 623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:38.182473 623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:38.185894 623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:38.186118 623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:38.193550 623 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40645
I20260807 18:47:38.193579 692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40645 every 8 connection(s)
I20260807 18:47:38.194507 623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:38.197213 693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:38.197556 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 623
I20260807 18:47:38.197690 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:38.197995 10939 external_mini_cluster.cc:1428] Setting key 380e30f1ba0cb228acaa4b959469bc9d
I20260807 18:47:38.203759 693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56: Bootstrap starting.
I20260807 18:47:38.206179 693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:38.206954 696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:38.199391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:58195 (local address 127.0.0.1:40645)
0807 18:47:38.199838 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:38.199854 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:38.199889 (+ 35us) server_negotiation.cc:407] Connection header received
0807 18:47:38.200600 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:38.200617 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:38.200942 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:38.201271 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:38.201676 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:38.202631 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:38.203619 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:38.204129 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:38.204331 (+ 202us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:38.205280 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:38.205285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:38.205297 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:38.205672 (+ 375us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:38.205725 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:38.205747 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:38.205896 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:38.206080 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 18:47:38.206216 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":143,"threads_started":1}
I20260807 18:47:38.207000 693 log.cc:824] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:38.209403 693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56: No bootstrap required, opened a new log
I20260807 18:47:38.210180 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:38.213318 693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9beb2d8d8ac34671946a1315076eab56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40645 } }
I20260807 18:47:38.213567 693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:38.213649 693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9beb2d8d8ac34671946a1315076eab56, State: Initialized, Role: FOLLOWER
I20260807 18:47:38.214121 693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9beb2d8d8ac34671946a1315076eab56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40645 } }
I20260807 18:47:38.214287 693 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:38.214382 693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:38.214485 693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:38.215492 693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9beb2d8d8ac34671946a1315076eab56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40645 } }
I20260807 18:47:38.215909 693 leader_election.cc:302] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9beb2d8d8ac34671946a1315076eab56; no voters:
I20260807 18:47:38.216287 693 leader_election.cc:288] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:38.216362 703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:38.216605 696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:38.212309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:54965 (local address 127.0.0.1:40645)
0807 18:47:38.212419 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:38.212423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:38.212653 (+ 230us) server_negotiation.cc:407] Connection header received
0807 18:47:38.212809 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:38.212813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:38.212864 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:38.212947 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:38.213205 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:38.213821 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:38.214796 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:38.215077 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:38.215186 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:38.216086 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:38.216090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:38.216093 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:38.216106 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:38.216139 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:38.216149 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:38.216246 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:38.216380 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 18:47:38.216416 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 18:47:38.216614 703 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [term 1 LEADER]: Becoming Leader. State: Replica: 9beb2d8d8ac34671946a1315076eab56, State: Running, Role: LEADER
I20260807 18:47:38.217010 703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9beb2d8d8ac34671946a1315076eab56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40645 } }
I20260807 18:47:38.217662 693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:38.218632 705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9beb2d8d8ac34671946a1315076eab56. Latest consensus state: current_term: 1 leader_uuid: "9beb2d8d8ac34671946a1315076eab56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9beb2d8d8ac34671946a1315076eab56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40645 } } }
I20260807 18:47:38.218914 704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9beb2d8d8ac34671946a1315076eab56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9beb2d8d8ac34671946a1315076eab56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40645 } } }
I20260807 18:47:38.219029 705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:38.219115 704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:38.220175 714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:38.222690 714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:38.227720 714 catalog_manager.cc:1347] Generated new cluster ID: 17dbbd3577414b7c96e5b0115bf84632
I20260807 18:47:38.227783 714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:38.238179 714 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:38.239439 714 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:38.248744 714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9beb2d8d8ac34671946a1315076eab56: Generated new TSK 0
I20260807 18:47:38.249464 714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:38.253630 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 623
W20260807 18:47:38.260344 608 connection.cc:535] client connection to 127.0.0.1:40645 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40645): Connection reset by peer (error 104)
2026-08-07T18:47:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:38 dist-test-slave-07c2 krb5kdc[724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:38 dist-test-slave-07c2 krb5kdc[724](info): set up 2 sockets
Aug 07 18:47:38 dist-test-slave-07c2 krb5kdc[724](info): commencing operation
krb5kdc: starting...
W20260807 18:47:39.302532 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:39 dist-test-slave-07c2 krb5kdc[724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 18:47:39.439018 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:39.558714 737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:39.559082 737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:39.559166 737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:39.563366 737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:39.563488 737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:39.563525 737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:39.563571 737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:39.563616 737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:39.569218 737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45961
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:39.570391 737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:39.571509 737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:39.582366 745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:39.582367 743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:39.582367 742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:39.582635 737 server_base.cc:1034] running on GCE node
I20260807 18:47:39.583426 737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:39.584585 737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:39.585755 737 hybrid_clock.cc:648] HybridClock initialized: now 1786128459585727 us; error 40 us; skew 500 ppm
Aug 07 18:47:39 dist-test-slave-07c2 krb5kdc[724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128459, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:39.588809 737 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 18:47:39.589751 737 webserver.cc:460] Webserver started at http://127.0.0.1:41377/ using document root <none> and password file <none>
I20260807 18:47:39.590427 737 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:39.590533 737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:39.590790 737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:39.593040 737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa"
format_stamp: "Formatted at 2026-08-07 18:47:39 on dist-test-slave-07c2"
server_key: "fecbcfc3f6821471c20bec4f25b47ec6"
server_key_iv: "1fa25176a19c328b8ddba572a2132975"
server_key_version: "encryptionkey@0"
I20260807 18:47:39.593667 737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa"
format_stamp: "Formatted at 2026-08-07 18:47:39 on dist-test-slave-07c2"
server_key: "fecbcfc3f6821471c20bec4f25b47ec6"
server_key_iv: "1fa25176a19c328b8ddba572a2132975"
server_key_version: "encryptionkey@0"
I20260807 18:47:39.598040 737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:47:39.600880 752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:39.602239 737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 18:47:39.602402 737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa"
format_stamp: "Formatted at 2026-08-07 18:47:39 on dist-test-slave-07c2"
server_key: "fecbcfc3f6821471c20bec4f25b47ec6"
server_key_iv: "1fa25176a19c328b8ddba572a2132975"
server_key_version: "encryptionkey@0"
I20260807 18:47:39.602537 737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:39.607504 737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:39.611061 737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:39.611306 737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:39.618636 737 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45961
I20260807 18:47:39.618676 805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45961 every 8 connection(s)
I20260807 18:47:39.619683 737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:39.622614 806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:39.627585 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 737
I20260807 18:47:39.627740 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:39.628075 10939 external_mini_cluster.cc:1428] Setting key d4e1e5e9dca83e5be821c6650f9e54ec
I20260807 18:47:39.628960 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa: Bootstrap starting.
I20260807 18:47:39.631531 806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:39.632411 806 log.cc:824] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:39.633558 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:39.629519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:59981 (local address 127.0.0.1:45961)
0807 18:47:39.629988 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:39.630008 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:39.630047 (+ 39us) server_negotiation.cc:407] Connection header received
0807 18:47:39.630712 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:39.630730 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:39.631027 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:39.631394 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:39.632255 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:39.632259 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:39.632271 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:39.632295 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:39.632350 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:39.632370 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:39.632494 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:39.632602 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 18:47:39.632822 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":165,"threads_started":1}
I20260807 18:47:39.634771 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa: No bootstrap required, opened a new log
I20260807 18:47:39.636550 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:39.639060 806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45961 } }
I20260807 18:47:39.639441 806 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:39.639513 806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25cb5d78f0f748a9a3d3aaf961a52ffa, State: Initialized, Role: FOLLOWER
I20260807 18:47:39.640069 806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45961 } }
I20260807 18:47:39.640261 806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:39.640342 806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:39.640450 806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:39.640753 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:39.638822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:51071 (local address 127.0.0.1:45961)
0807 18:47:39.638965 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:39.638971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:39.639131 (+ 160us) server_negotiation.cc:407] Connection header received
0807 18:47:39.639218 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:39.639220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:39.639260 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:39.639376 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:39.640193 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:39.640197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:39.640200 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:39.640213 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:39.640246 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:39.640260 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:39.640356 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:39.640551 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 18:47:39.640602 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 18:47:39.641767 806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45961 } }
I20260807 18:47:39.642132 806 leader_election.cc:302] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25cb5d78f0f748a9a3d3aaf961a52ffa; no voters:
I20260807 18:47:39.642457 806 leader_election.cc:288] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:39.642576 816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:39.642830 816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [term 1 LEADER]: Becoming Leader. State: Replica: 25cb5d78f0f748a9a3d3aaf961a52ffa, State: Running, Role: LEADER
I20260807 18:47:39.643185 816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45961 } }
I20260807 18:47:39.643821 806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:39.645103 818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25cb5d78f0f748a9a3d3aaf961a52ffa. Latest consensus state: current_term: 1 leader_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45961 } } }
I20260807 18:47:39.645236 818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:39.645649 826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:39.646323 817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25cb5d78f0f748a9a3d3aaf961a52ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45961 } } }
I20260807 18:47:39.646461 817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:39.648527 826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:39.654095 826 catalog_manager.cc:1347] Generated new cluster ID: 4bfe680018594062b302fa9a5acbb3a1
I20260807 18:47:39.654201 826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:39.670231 826 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:39.670629 826 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:39.678133 826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25cb5d78f0f748a9a3d3aaf961a52ffa: Generated new TSK 0
I20260807 18:47:39.678989 826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:39.687988 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 737
2026-08-07T18:47:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1434 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:39 dist-test-slave-07c2 krb5kdc[838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:39 dist-test-slave-07c2 krb5kdc[838](info): set up 2 sockets
Aug 07 18:47:39 dist-test-slave-07c2 krb5kdc[838](info): commencing operation
krb5kdc: starting...
W20260807 18:47:40.750765 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:40 dist-test-slave-07c2 krb5kdc[838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:40.882908 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45139
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:37861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:45139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:40.994283 851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:40.994620 851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:40.994707 851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:40.998739 851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:40.998847 851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:40.998890 851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:40.998950 851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:40.998991 851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:41.004340 851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:37861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:45139
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:41.005473 851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:41.006537 851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:41.015129 856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:41.015136 859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:41.015136 857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:41.015448 851 server_base.cc:1034] running on GCE node
I20260807 18:47:41.016024 851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:41.017103 851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:41.018271 851 hybrid_clock.cc:648] HybridClock initialized: now 1786128461018248 us; error 30 us; skew 500 ppm
Aug 07 18:47:41 dist-test-slave-07c2 krb5kdc[838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:41.021082 851 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:41.021960 851 webserver.cc:460] Webserver started at http://127.10.174.254:45865/ using document root <none> and password file <none>
I20260807 18:47:41.022461 851 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:41.022519 851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:41.022678 851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:41.024693 851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "1b44e20589564684a54cfea0c5eaf51b"
format_stamp: "Formatted at 2026-08-07 18:47:41 on dist-test-slave-07c2"
server_key: "39047dcc89cd3fcaa1023afbef57cc91"
server_key_iv: "811cc98559fc7aaf340ae42c6d92c8a5"
server_key_version: "encryptionkey@0"
I20260807 18:47:41.025213 851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "1b44e20589564684a54cfea0c5eaf51b"
format_stamp: "Formatted at 2026-08-07 18:47:41 on dist-test-slave-07c2"
server_key: "39047dcc89cd3fcaa1023afbef57cc91"
server_key_iv: "811cc98559fc7aaf340ae42c6d92c8a5"
server_key_version: "encryptionkey@0"
I20260807 18:47:41.028870 851 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 18:47:41.031206 866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:41.032482 851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:41.032627 851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "1b44e20589564684a54cfea0c5eaf51b"
format_stamp: "Formatted at 2026-08-07 18:47:41 on dist-test-slave-07c2"
server_key: "39047dcc89cd3fcaa1023afbef57cc91"
server_key_iv: "811cc98559fc7aaf340ae42c6d92c8a5"
server_key_version: "encryptionkey@0"
I20260807 18:47:41.032742 851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:41.044293 851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:41.047708 851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:41.047940 851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:41.055248 851 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:45139
I20260807 18:47:41.055264 918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:45139 every 8 connection(s)
I20260807 18:47:41.056293 851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:41.059087 919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:41.060246 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 851
I20260807 18:47:41.060423 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:41.060734 10939 external_mini_cluster.cc:1428] Setting key 132e57e6a3e715e08b2810d1c57de6bb
I20260807 18:47:41.066143 919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b: Bootstrap starting.
I20260807 18:47:41.068912 919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:41.069679 919 log.cc:824] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b: Log is configured to *not* fsync() on all Append() calls
Aug 07 18:47:41 dist-test-slave-07c2 krb5kdc[838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:41.072201 919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b: No bootstrap required, opened a new log
I20260807 18:47:41.076435 919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b44e20589564684a54cfea0c5eaf51b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45139 } }
I20260807 18:47:41.076735 919 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:41.076817 919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b44e20589564684a54cfea0c5eaf51b, State: Initialized, Role: FOLLOWER
I20260807 18:47:41.077255 919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b44e20589564684a54cfea0c5eaf51b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45139 } }
I20260807 18:47:41.077409 919 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:41.077498 919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:41.077625 919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:41.077767 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:41.062273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42541 (local address 127.10.174.254:45139)
0807 18:47:41.062733 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:41.062753 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:41.062797 (+ 44us) server_negotiation.cc:407] Connection header received
0807 18:47:41.063672 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:41.063694 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:41.064141 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:41.064538 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:41.065304 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:41.066749 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:41.067792 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:41.068489 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:41.068667 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:41.071791 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:41.071798 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:41.071814 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:41.071847 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:41.073799 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:41.074484 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:41.074490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:41.074495 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:41.074645 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:41.075025 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:41.075028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:41.075029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:41.075783 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:41.075983 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:41.076421 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 18:47:41.076705 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":133,"threads_started":1}
I20260807 18:47:41.078681 919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b44e20589564684a54cfea0c5eaf51b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45139 } }
I20260807 18:47:41.079035 919 leader_election.cc:302] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b44e20589564684a54cfea0c5eaf51b; no voters:
I20260807 18:47:41.079413 919 leader_election.cc:288] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:41.079533 924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:41.079782 924 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [term 1 LEADER]: Becoming Leader. State: Replica: 1b44e20589564684a54cfea0c5eaf51b, State: Running, Role: LEADER
I20260807 18:47:41.080120 924 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b44e20589564684a54cfea0c5eaf51b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45139 } }
I20260807 18:47:41.080652 919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:41.080804 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:41.081351 924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b44e20589564684a54cfea0c5eaf51b. Latest consensus state: current_term: 1 leader_uuid: "1b44e20589564684a54cfea0c5eaf51b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b44e20589564684a54cfea0c5eaf51b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45139 } } }
I20260807 18:47:41.082105 924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:41.081986 925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b44e20589564684a54cfea0c5eaf51b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b44e20589564684a54cfea0c5eaf51b" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45139 } } }
I20260807 18:47:41.082436 925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b [sys.catalog]: This master's current role is: LEADER
W20260807 18:47:41.085716 944 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:41.085796 944 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:41.085855 937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:41.086678 937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:41.092494 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:41.083468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52573 (local address 127.10.174.254:45139)
0807 18:47:41.083582 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:41.083589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:41.083911 (+ 322us) server_negotiation.cc:407] Connection header received
0807 18:47:41.084038 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:41.084040 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:41.084077 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:41.084171 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:41.085060 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:41.085816 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:41.086923 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:41.087275 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:41.087413 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:41.089098 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:41.089102 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:41.089107 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:41.089140 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:41.090621 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:41.091110 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:41.091116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:41.091122 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:41.091226 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:41.091628 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:41.091631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:41.091633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:41.091808 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:41.091966 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:41.092243 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 18:47:41.092339 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 18:47:41.093324 937 catalog_manager.cc:1347] Generated new cluster ID: b45db2a828e74840895751418a994a92
I20260807 18:47:41.093386 937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:41.110199 937 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:41.111140 937 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:41.120123 937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b44e20589564684a54cfea0c5eaf51b: Generated new TSK 0
I20260807 18:47:41.120934 937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:41.130275 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 851
W20260807 18:47:41.136984 836 connection.cc:535] client connection to 127.10.174.254:45139 recv error: Network error: failed to read from TLS socket (remote: 127.10.174.254:45139): Connection reset by peer (error 104)
2026-08-07T18:47:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:41 dist-test-slave-07c2 krb5kdc[951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:41 dist-test-slave-07c2 krb5kdc[951](info): set up 2 sockets
Aug 07 18:47:41 dist-test-slave-07c2 krb5kdc[951](info): commencing operation
krb5kdc: starting...
W20260807 18:47:42.202524 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:42 dist-test-slave-07c2 krb5kdc[951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:42.334223 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45765
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:45765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:42.451082 964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:42.451457 964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:42.451561 964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:42.455873 964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:42.455942 964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:42.455962 964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:42.455979 964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:42.456032 964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:42.461639 964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:45765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:45765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:42.462832 964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:42.463975 964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:42.472980 972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:42.473140 964 server_base.cc:1034] running on GCE node
W20260807 18:47:42.472993 969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:42.473338 970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:42.473922 964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:42.475149 964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:42.476321 964 hybrid_clock.cc:648] HybridClock initialized: now 1786128462476302 us; error 34 us; skew 500 ppm
Aug 07 18:47:42 dist-test-slave-07c2 krb5kdc[951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128462, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:42.479385 964 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:42.480402 964 webserver.cc:460] Webserver started at http://127.10.174.254:38291/ using document root <none> and password file <none>
I20260807 18:47:42.480994 964 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:42.481060 964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:42.481335 964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:42.483615 964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "6e640b01fc1342bca8bc10a926ccb819"
format_stamp: "Formatted at 2026-08-07 18:47:42 on dist-test-slave-07c2"
server_key: "71aceb749ef18ed075018ea96241bca2"
server_key_iv: "3ee1d446ddd1a801fe036df0d9af9302"
server_key_version: "encryptionkey@0"
I20260807 18:47:42.484236 964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "6e640b01fc1342bca8bc10a926ccb819"
format_stamp: "Formatted at 2026-08-07 18:47:42 on dist-test-slave-07c2"
server_key: "71aceb749ef18ed075018ea96241bca2"
server_key_iv: "3ee1d446ddd1a801fe036df0d9af9302"
server_key_version: "encryptionkey@0"
I20260807 18:47:42.488394 964 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 18:47:42.491097 980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:42.492480 964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:42.492678 964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "6e640b01fc1342bca8bc10a926ccb819"
format_stamp: "Formatted at 2026-08-07 18:47:42 on dist-test-slave-07c2"
server_key: "71aceb749ef18ed075018ea96241bca2"
server_key_iv: "3ee1d446ddd1a801fe036df0d9af9302"
server_key_version: "encryptionkey@0"
I20260807 18:47:42.492811 964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:42.516378 964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:42.519681 964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:42.519909 964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:42.527390 964 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:45765
I20260807 18:47:42.527418 1032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:45765 every 8 connection(s)
I20260807 18:47:42.528385 964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:42.531124 1033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:42.532269 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 964
I20260807 18:47:42.532428 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:42.532779 10939 external_mini_cluster.cc:1428] Setting key 5b86c15eb4dba4fa5f2ba483486b9688
I20260807 18:47:42.537384 1033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819: Bootstrap starting.
I20260807 18:47:42.539664 1033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:42.540408 1033 log.cc:824] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:42.542459 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:42.534328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45239 (local address 127.10.174.254:45765)
0807 18:47:42.534913 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:42.534929 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:42.534968 (+ 39us) server_negotiation.cc:407] Connection header received
0807 18:47:42.535837 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:42.535857 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:42.536193 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:42.536549 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:42.536959 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:42.537961 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:42.538884 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:42.539424 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:42.539601 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:42.540568 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:42.540574 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:42.540592 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:42.541114 (+ 522us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:42.541187 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:42.541221 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:42.541383 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:42.541576 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 18:47:42.541727 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":153,"threads_started":1}
I20260807 18:47:42.542500 1033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819: No bootstrap required, opened a new log
I20260807 18:47:42.546267 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:42.546270 1033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e640b01fc1342bca8bc10a926ccb819" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45765 } }
I20260807 18:47:42.546576 1033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:42.546635 1033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e640b01fc1342bca8bc10a926ccb819, State: Initialized, Role: FOLLOWER
I20260807 18:47:42.547096 1033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e640b01fc1342bca8bc10a926ccb819" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45765 } }
I20260807 18:47:42.547255 1033 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:42.547341 1033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:42.547467 1033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:42.548666 1033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e640b01fc1342bca8bc10a926ccb819" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45765 } }
I20260807 18:47:42.549103 1033 leader_election.cc:302] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e640b01fc1342bca8bc10a926ccb819; no voters:
I20260807 18:47:42.549453 1033 leader_election.cc:288] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:42.549577 1043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:42.549855 1043 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [term 1 LEADER]: Becoming Leader. State: Replica: 6e640b01fc1342bca8bc10a926ccb819, State: Running, Role: LEADER
I20260807 18:47:42.550237 1043 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e640b01fc1342bca8bc10a926ccb819" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45765 } }
I20260807 18:47:42.550840 1033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:42.552125 1045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e640b01fc1342bca8bc10a926ccb819. Latest consensus state: current_term: 1 leader_uuid: "6e640b01fc1342bca8bc10a926ccb819" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e640b01fc1342bca8bc10a926ccb819" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45765 } } }
I20260807 18:47:42.552285 1045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:42.552716 1052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:42.552939 1044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e640b01fc1342bca8bc10a926ccb819" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e640b01fc1342bca8bc10a926ccb819" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 45765 } } }
I20260807 18:47:42.553095 1044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:42.554044 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:42.548634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54967 (local address 127.10.174.254:45765)
0807 18:47:42.548777 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:42.548783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:42.548980 (+ 197us) server_negotiation.cc:407] Connection header received
0807 18:47:42.549141 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:42.549144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:42.549200 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:42.549314 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:42.549664 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:42.550430 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:42.551742 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:42.552064 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:42.552172 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:42.553451 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:42.553454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:42.553457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:42.553471 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:42.553503 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:42.553520 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:42.553614 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:42.553867 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 18:47:42.553906 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 18:47:42.556284 1052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:42.562459 1052 catalog_manager.cc:1347] Generated new cluster ID: 726fe76e56ac41878fc45e03c47d92cd
I20260807 18:47:42.562573 1052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:42.572125 1052 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:42.573060 1052 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:42.579777 1052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e640b01fc1342bca8bc10a926ccb819: Generated new TSK 0
I20260807 18:47:42.580649 1052 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:42.593255 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 964
W20260807 18:47:42.599776 949 connection.cc:535] client connection to 127.10.174.254:45765 recv error: Network error: failed to read from TLS socket (remote: 127.10.174.254:45765): Connection reset by peer (error 104)
2026-08-07T18:47:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1462 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:42 dist-test-slave-07c2 krb5kdc[1064](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:42 dist-test-slave-07c2 krb5kdc[1064](info): set up 2 sockets
Aug 07 18:47:42 dist-test-slave-07c2 krb5kdc[1064](info): commencing operation
krb5kdc: starting...
W20260807 18:47:43.792167 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:43 dist-test-slave-07c2 krb5kdc[1064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:43.994328 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43755
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:35291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:44.109167 1077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:44.109484 1077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:44.109534 1077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:44.114434 1077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:44.114508 1077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:44.114531 1077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:44.114550 1077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:44.114566 1077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:44.120201 1077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:35291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43755
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:44.121265 1077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:44.122279 1077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:44.131179 1082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:44.131179 1085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:44.131183 1083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:44.131606 1077 server_base.cc:1034] running on GCE node
I20260807 18:47:44.132262 1077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:44.133457 1077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:44.134627 1077 hybrid_clock.cc:648] HybridClock initialized: now 1786128464134617 us; error 29 us; skew 500 ppm
Aug 07 18:47:44 dist-test-slave-07c2 krb5kdc[1064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128464, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:44.145460 1077 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:44.146683 1077 webserver.cc:460] Webserver started at http://127.10.174.254:34927/ using document root <none> and password file <none>
I20260807 18:47:44.147368 1077 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:44.147470 1077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:44.147715 1077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:44.149950 1077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "f737baead13a4f87bb1b01dd78c8ffe3"
format_stamp: "Formatted at 2026-08-07 18:47:44 on dist-test-slave-07c2"
server_key: "324c5bda3060a0e2b0c2181b0d25f7d9"
server_key_iv: "d17a4a5d0ff8f8ae3403f30e4c0bf3d5"
server_key_version: "encryptionkey@0"
I20260807 18:47:44.150540 1077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "f737baead13a4f87bb1b01dd78c8ffe3"
format_stamp: "Formatted at 2026-08-07 18:47:44 on dist-test-slave-07c2"
server_key: "324c5bda3060a0e2b0c2181b0d25f7d9"
server_key_iv: "d17a4a5d0ff8f8ae3403f30e4c0bf3d5"
server_key_version: "encryptionkey@0"
I20260807 18:47:44.154488 1077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 18:47:44.157052 1093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:44.158246 1077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 18:47:44.158390 1077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "f737baead13a4f87bb1b01dd78c8ffe3"
format_stamp: "Formatted at 2026-08-07 18:47:44 on dist-test-slave-07c2"
server_key: "324c5bda3060a0e2b0c2181b0d25f7d9"
server_key_iv: "d17a4a5d0ff8f8ae3403f30e4c0bf3d5"
server_key_version: "encryptionkey@0"
I20260807 18:47:44.158504 1077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:44.163132 1077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:44.166047 1077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:44.166252 1077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:44.173269 1077 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:43755
I20260807 18:47:44.173295 1148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:43755 every 8 connection(s)
I20260807 18:47:44.174136 1077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:44.176849 1149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:44.182029 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1077
I20260807 18:47:44.182147 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:44.182392 1149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3: Bootstrap starting.
I20260807 18:47:44.182453 10939 external_mini_cluster.cc:1428] Setting key 186671f01a4a8ac89ae83231270fddf3
I20260807 18:47:44.185137 1149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:44.185966 1149 log.cc:824] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:44.188051 1152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:44.184059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48941 (local address 127.10.174.254:43755)
0807 18:47:44.184527 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:44.184543 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:44.184578 (+ 35us) server_negotiation.cc:407] Connection header received
0807 18:47:44.185233 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:44.185277 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:44.185588 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:44.185877 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:44.186841 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:44.186846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:44.186857 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:44.186868 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:44.186924 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:44.186943 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:44.187067 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:44.187180 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 18:47:44.187388 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":140,"threads_started":1}
I20260807 18:47:44.188066 1149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3: No bootstrap required, opened a new log
I20260807 18:47:44.191066 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:44.192437 1149 raft_consensus.cc:348] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43755 } }
I20260807 18:47:44.192682 1149 raft_consensus.cc:374] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:44.192754 1149 raft_consensus.cc:729] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f737baead13a4f87bb1b01dd78c8ffe3, State: Initialized, Role: FOLLOWER
I20260807 18:47:44.193252 1149 consensus_queue.cc:260] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43755 } }
I20260807 18:47:44.193428 1149 raft_consensus.cc:388] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:44.193499 1149 raft_consensus.cc:482] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:44.193598 1149 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:44.194744 1149 raft_consensus.cc:504] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43755 } }
I20260807 18:47:44.195120 1152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:44.193295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41835 (local address 127.10.174.254:43755)
0807 18:47:44.193438 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:44.193442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:44.193696 (+ 254us) server_negotiation.cc:407] Connection header received
0807 18:47:44.193839 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:44.193843 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:44.193887 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:44.193973 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:44.194725 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:44.194728 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:44.194731 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:44.194742 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:44.194783 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:44.194795 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:44.194887 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:44.194961 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 18:47:44.195004 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 18:47:44.195155 1149 leader_election.cc:302] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f737baead13a4f87bb1b01dd78c8ffe3; no voters:
I20260807 18:47:44.195541 1149 leader_election.cc:288] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:44.195632 1159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:44.195899 1159 raft_consensus.cc:686] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [term 1 LEADER]: Becoming Leader. State: Replica: f737baead13a4f87bb1b01dd78c8ffe3, State: Running, Role: LEADER
I20260807 18:47:44.196372 1159 consensus_queue.cc:237] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43755 } }
I20260807 18:47:44.196866 1149 sys_catalog.cc:564] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:44.197530 1159 sys_catalog.cc:455] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43755 } } }
I20260807 18:47:44.197707 1159 sys_catalog.cc:458] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:44.197999 1160 sys_catalog.cc:455] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f737baead13a4f87bb1b01dd78c8ffe3. Latest consensus state: current_term: 1 leader_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f737baead13a4f87bb1b01dd78c8ffe3" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43755 } } }
I20260807 18:47:44.198139 1167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:44.198173 1160 sys_catalog.cc:458] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:44.201367 1167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:44.206782 1167 catalog_manager.cc:1347] Generated new cluster ID: e07ff196023a443482fbeb163b622a0d
I20260807 18:47:44.206923 1167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:44.236692 1167 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:44.237059 1167 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:44.244724 1167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f737baead13a4f87bb1b01dd78c8ffe3: Generated new TSK 0
I20260807 18:47:44.245443 1167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:44.253497 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1077
2026-08-07T18:47:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1660 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:44 dist-test-slave-07c2 krb5kdc[1180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:44 dist-test-slave-07c2 krb5kdc[1180](info): set up 2 sockets
Aug 07 18:47:44 dist-test-slave-07c2 krb5kdc[1180](info): commencing operation
krb5kdc: starting...
W20260807 18:47:45.314496 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:45 dist-test-slave-07c2 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:45.441747 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:37397
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:34827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:37397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:45.553632 1194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:45.553982 1194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:45.554069 1194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:45.558246 1194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:45.558346 1194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:45.558387 1194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:45.558445 1194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:45.558485 1194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:45.564024 1194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:34827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:37397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:37397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:45.565126 1194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:45.566152 1194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:45.575616 1200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:45.575655 1203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:45.576124 1201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:45.576161 1194 server_base.cc:1034] running on GCE node
I20260807 18:47:45.576839 1194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:45.578228 1194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:45.581470 1194 hybrid_clock.cc:648] HybridClock initialized: now 1786128465581440 us; error 44 us; skew 500 ppm
Aug 07 18:47:45 dist-test-slave-07c2 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128465, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:45.584344 1194 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:45.585343 1194 webserver.cc:460] Webserver started at http://127.10.174.254:42477/ using document root <none> and password file <none>
I20260807 18:47:45.585922 1194 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:45.586016 1194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:45.586302 1194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:45.588487 1194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "7908d1eb7ab84ceb90d289b8f67da596"
format_stamp: "Formatted at 2026-08-07 18:47:45 on dist-test-slave-07c2"
server_key: "01edcb0f42aeb1d5cbbf0173aa99283e"
server_key_iv: "aa9dd7770a0f5e9e3535cbba273f92e6"
server_key_version: "encryptionkey@0"
I20260807 18:47:45.589088 1194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "7908d1eb7ab84ceb90d289b8f67da596"
format_stamp: "Formatted at 2026-08-07 18:47:45 on dist-test-slave-07c2"
server_key: "01edcb0f42aeb1d5cbbf0173aa99283e"
server_key_iv: "aa9dd7770a0f5e9e3535cbba273f92e6"
server_key_version: "encryptionkey@0"
I20260807 18:47:45.593044 1194 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 18:47:45.595573 1210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:45.596817 1194 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:45.596976 1194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "7908d1eb7ab84ceb90d289b8f67da596"
format_stamp: "Formatted at 2026-08-07 18:47:45 on dist-test-slave-07c2"
server_key: "01edcb0f42aeb1d5cbbf0173aa99283e"
server_key_iv: "aa9dd7770a0f5e9e3535cbba273f92e6"
server_key_version: "encryptionkey@0"
I20260807 18:47:45.597103 1194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:45.629742 1194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:45.632869 1194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:45.633095 1194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:45.640904 1194 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:37397
I20260807 18:47:45.640936 1262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:37397 every 8 connection(s)
I20260807 18:47:45.641924 1194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:45.644627 1263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:45.648777 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1194
I20260807 18:47:45.648943 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:45.649252 10939 external_mini_cluster.cc:1428] Setting key 2bc7e12568849bffe1952b5980b30214
I20260807 18:47:45.650308 1263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596: Bootstrap starting.
I20260807 18:47:45.652597 1263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:45.653343 1263 log.cc:824] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:45.655148 1263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596: No bootstrap required, opened a new log
Aug 07 18:47:45 dist-test-slave-07c2 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:45.659101 1263 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7908d1eb7ab84ceb90d289b8f67da596" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 37397 } }
I20260807 18:47:45.659373 1263 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:45.659457 1263 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7908d1eb7ab84ceb90d289b8f67da596, State: Initialized, Role: FOLLOWER
I20260807 18:47:45.659991 1263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7908d1eb7ab84ceb90d289b8f67da596" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 37397 } }
I20260807 18:47:45.660123 1263 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:45.660216 1263 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:45.660336 1263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:45.661243 1263 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7908d1eb7ab84ceb90d289b8f67da596" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 37397 } }
I20260807 18:47:45.661592 1263 leader_election.cc:302] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7908d1eb7ab84ceb90d289b8f67da596; no voters:
I20260807 18:47:45.661900 1263 leader_election.cc:288] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:45.662032 1269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:45.662286 1269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [term 1 LEADER]: Becoming Leader. State: Replica: 7908d1eb7ab84ceb90d289b8f67da596, State: Running, Role: LEADER
I20260807 18:47:45.662626 1269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7908d1eb7ab84ceb90d289b8f67da596" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 37397 } }
I20260807 18:47:45.663323 1263 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:45.663933 1271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7908d1eb7ab84ceb90d289b8f67da596. Latest consensus state: current_term: 1 leader_uuid: "7908d1eb7ab84ceb90d289b8f67da596" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7908d1eb7ab84ceb90d289b8f67da596" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 37397 } } }
I20260807 18:47:45.664083 1271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:45.664407 1270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7908d1eb7ab84ceb90d289b8f67da596" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7908d1eb7ab84ceb90d289b8f67da596" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 37397 } } }
I20260807 18:47:45.664505 1270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:45.664796 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:45.650670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45817 (local address 127.10.174.254:37397)
0807 18:47:45.651112 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:45.651127 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:45.651172 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:47:45.651890 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:45.651907 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:45.652255 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:45.652594 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:45.653476 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:45.654549 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:45.655574 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:45.656125 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:45.656330 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:45.659207 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:45.659213 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:45.659226 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:45.659253 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:45.661262 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:45.661739 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:45.661745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:45.661751 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:45.661906 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:45.662304 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:45.662309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:45.662311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:45.662845 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:45.663043 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:45.663403 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 18:47:45.663746 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":134,"threads_started":1}
I20260807 18:47:45.668395 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 18:47:45.668848 1285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:45.668926 1285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:45.669031 1278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:45.669920 1278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:45.675793 1278 catalog_manager.cc:1347] Generated new cluster ID: a69aa1ed9fbc4a6caa321ee4c26deb81
I20260807 18:47:45.675863 1278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:45.679877 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:45.670700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57195 (local address 127.10.174.254:37397)
0807 18:47:45.670822 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:45.670826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:45.671091 (+ 265us) server_negotiation.cc:407] Connection header received
0807 18:47:45.671218 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:45.671222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:45.671264 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:45.671387 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:45.672165 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:45.673064 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:45.674220 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:45.674586 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:45.674700 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:45.676410 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:45.676415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:45.676417 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:45.676443 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:45.678035 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:45.678506 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:45.678511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:45.678513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:45.678600 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:45.678917 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:45.678920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:45.678922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:45.679108 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:45.679251 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:45.679532 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 18:47:45.679671 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 18:47:45.688216 1278 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:45.689186 1278 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:45.696590 1278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7908d1eb7ab84ceb90d289b8f67da596: Generated new TSK 0
I20260807 18:47:45.697377 1278 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:45.701839 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1194
2026-08-07T18:47:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:45 dist-test-slave-07c2 krb5kdc[1296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:45 dist-test-slave-07c2 krb5kdc[1296](info): set up 2 sockets
Aug 07 18:47:45 dist-test-slave-07c2 krb5kdc[1296](info): commencing operation
krb5kdc: starting...
W20260807 18:47:46.770406 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:46 dist-test-slave-07c2 krb5kdc[1296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:46.896565 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43481
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:47.009663 1309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:47.009963 1309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:47.010005 1309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:47.014240 1309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:47.014313 1309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:47.014333 1309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:47.014351 1309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:47.014389 1309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:47.020000 1309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43481
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:47.021131 1309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:47.022171 1309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:47.030877 1317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:47.030872 1314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:47.030872 1315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:47.031103 1309 server_base.cc:1034] running on GCE node
I20260807 18:47:47.031940 1309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:47.033097 1309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:47.034293 1309 hybrid_clock.cc:648] HybridClock initialized: now 1786128467034281 us; error 27 us; skew 500 ppm
Aug 07 18:47:47 dist-test-slave-07c2 krb5kdc[1296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128467, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:47.037192 1309 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:47.038127 1309 webserver.cc:460] Webserver started at http://127.10.174.254:40851/ using document root <none> and password file <none>
I20260807 18:47:47.038690 1309 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:47.038807 1309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:47.039042 1309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:47.041152 1309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "831e06754db84558ac33bb7dec1e6786"
format_stamp: "Formatted at 2026-08-07 18:47:47 on dist-test-slave-07c2"
server_key: "47c9fb9d7d6edd2c2eb83da9e3bfca04"
server_key_iv: "43b3393f6a4cf4e8cfe94258388688ae"
server_key_version: "encryptionkey@0"
I20260807 18:47:47.041733 1309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "831e06754db84558ac33bb7dec1e6786"
format_stamp: "Formatted at 2026-08-07 18:47:47 on dist-test-slave-07c2"
server_key: "47c9fb9d7d6edd2c2eb83da9e3bfca04"
server_key_iv: "43b3393f6a4cf4e8cfe94258388688ae"
server_key_version: "encryptionkey@0"
I20260807 18:47:47.045490 1309 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:47:47.047924 1324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:47.049108 1309 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:47.049255 1309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "831e06754db84558ac33bb7dec1e6786"
format_stamp: "Formatted at 2026-08-07 18:47:47 on dist-test-slave-07c2"
server_key: "47c9fb9d7d6edd2c2eb83da9e3bfca04"
server_key_iv: "43b3393f6a4cf4e8cfe94258388688ae"
server_key_version: "encryptionkey@0"
I20260807 18:47:47.049372 1309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:47.066447 1309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:47.070036 1309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:47.070263 1309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:47.077950 1309 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:43481
I20260807 18:47:47.077978 1379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:43481 every 8 connection(s)
I20260807 18:47:47.078960 1309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:47.081800 1380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:47.084023 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1309
I20260807 18:47:47.084131 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:47.084403 10939 external_mini_cluster.cc:1428] Setting key 6de3d1b75744f70604921783c995e02e
I20260807 18:47:47.087944 1380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786: Bootstrap starting.
I20260807 18:47:47.090416 1380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:47.091180 1380 log.cc:824] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:47.093479 1380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786: No bootstrap required, opened a new log
I20260807 18:47:47.093761 1383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:47.085848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43521 (local address 127.10.174.254:43481)
0807 18:47:47.086317 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:47.086331 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:47.086367 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:47:47.087007 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:47.087023 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:47.087449 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:47.087831 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:47.088263 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:47.089229 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:47.090380 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:47.090906 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:47.091095 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:47.091967 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:47.091976 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:47.091994 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:47.092417 (+ 423us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:47.092470 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:47.092493 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:47.092572 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:47.092741 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 18:47:47.092966 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":154,"threads_started":1}
I20260807 18:47:47.096728 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:47.097651 1380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831e06754db84558ac33bb7dec1e6786" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43481 } }
I20260807 18:47:47.097903 1380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:47.098016 1380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831e06754db84558ac33bb7dec1e6786, State: Initialized, Role: FOLLOWER
I20260807 18:47:47.098455 1380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831e06754db84558ac33bb7dec1e6786" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43481 } }
I20260807 18:47:47.098625 1380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:47.098706 1380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:47.098827 1380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:47.100178 1380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831e06754db84558ac33bb7dec1e6786" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43481 } }
I20260807 18:47:47.100589 1380 leader_election.cc:302] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 831e06754db84558ac33bb7dec1e6786; no voters:
I20260807 18:47:47.100943 1380 leader_election.cc:288] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:47.101075 1391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:47.101328 1391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [term 1 LEADER]: Becoming Leader. State: Replica: 831e06754db84558ac33bb7dec1e6786, State: Running, Role: LEADER
I20260807 18:47:47.101673 1391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831e06754db84558ac33bb7dec1e6786" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43481 } }
I20260807 18:47:47.102378 1380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:47.102829 1391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 831e06754db84558ac33bb7dec1e6786. Latest consensus state: current_term: 1 leader_uuid: "831e06754db84558ac33bb7dec1e6786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831e06754db84558ac33bb7dec1e6786" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43481 } } }
I20260807 18:47:47.103021 1391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:47.103319 1393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "831e06754db84558ac33bb7dec1e6786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831e06754db84558ac33bb7dec1e6786" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43481 } } }
I20260807 18:47:47.103428 1393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:47.103627 1395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:47.103663 1383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:47.098893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51505 (local address 127.10.174.254:43481)
0807 18:47:47.099017 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:47.099021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:47.099277 (+ 256us) server_negotiation.cc:407] Connection header received
0807 18:47:47.099426 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:47.099428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:47.099471 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:47.099538 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:47.099834 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:47.100396 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:47.101493 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:47.101806 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:47.101883 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:47.102972 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:47.102975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:47.102978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:47.102990 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:47.103019 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:47.103031 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:47.103087 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:47.103276 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 18:47:47.103376 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 18:47:47.107350 1395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:47.113169 1395 catalog_manager.cc:1347] Generated new cluster ID: 395c365feafa49c2bfa94e08713651bb
I20260807 18:47:47.113258 1395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:47.144006 1395 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:47.145298 1395 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:47.151574 1395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 831e06754db84558ac33bb7dec1e6786: Generated new TSK 0
I20260807 18:47:47.152364 1395 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:47.159539 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1309
2026-08-07T18:47:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:47 dist-test-slave-07c2 krb5kdc[1413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:47 dist-test-slave-07c2 krb5kdc[1413](info): set up 2 sockets
Aug 07 18:47:47 dist-test-slave-07c2 krb5kdc[1413](info): commencing operation
krb5kdc: starting...
W20260807 18:47:48.218173 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:48 dist-test-slave-07c2 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:48.345685 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39875
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:44311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:39875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:48.456703 1426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:48.457036 1426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:48.457119 1426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:48.461243 1426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:48.461334 1426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:48.461372 1426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:48.461429 1426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:48.461468 1426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:48.466758 1426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:44311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:39875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:39875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:48.467897 1426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:48.468935 1426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:48.478257 1431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:48.478262 1432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:48.478257 1434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:48.478358 1426 server_base.cc:1034] running on GCE node
I20260807 18:47:48.479256 1426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:48.480512 1426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:48.481701 1426 hybrid_clock.cc:648] HybridClock initialized: now 1786128468481677 us; error 52 us; skew 500 ppm
Aug 07 18:47:48 dist-test-slave-07c2 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128468, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:48.484488 1426 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:48.485425 1426 webserver.cc:460] Webserver started at http://127.10.174.254:32789/ using document root <none> and password file <none>
I20260807 18:47:48.485994 1426 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:48.486088 1426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:48.486340 1426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:48.488556 1426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "53815693ee464a5abdf196e27387ea69"
format_stamp: "Formatted at 2026-08-07 18:47:48 on dist-test-slave-07c2"
server_key: "0884c309e5d9134a5b0d1073080c357b"
server_key_iv: "69cf955fb60a7e2032741c76e7a4ae4e"
server_key_version: "encryptionkey@0"
I20260807 18:47:48.489177 1426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "53815693ee464a5abdf196e27387ea69"
format_stamp: "Formatted at 2026-08-07 18:47:48 on dist-test-slave-07c2"
server_key: "0884c309e5d9134a5b0d1073080c357b"
server_key_iv: "69cf955fb60a7e2032741c76e7a4ae4e"
server_key_version: "encryptionkey@0"
I20260807 18:47:48.493257 1426 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 18:47:48.495813 1441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:48.496985 1426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:48.497133 1426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "53815693ee464a5abdf196e27387ea69"
format_stamp: "Formatted at 2026-08-07 18:47:48 on dist-test-slave-07c2"
server_key: "0884c309e5d9134a5b0d1073080c357b"
server_key_iv: "69cf955fb60a7e2032741c76e7a4ae4e"
server_key_version: "encryptionkey@0"
I20260807 18:47:48.497249 1426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:48.501899 1426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:48.505160 1426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:48.505363 1426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:48.512271 1426 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:39875
I20260807 18:47:48.512300 1495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:39875 every 8 connection(s)
I20260807 18:47:48.513183 1426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:48.515897 1496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:48.521459 1496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69: Bootstrap starting.
I20260807 18:47:48.522310 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1426
I20260807 18:47:48.522467 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:48.522789 10939 external_mini_cluster.cc:1428] Setting key 22aee923cff3396071273a5922261f51
I20260807 18:47:48.524418 1496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:48.525336 1496 log.cc:824] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:48.527681 1496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69: No bootstrap required, opened a new log
I20260807 18:47:48.528492 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:48.523967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39481 (local address 127.10.174.254:39875)
0807 18:47:48.524510 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:48.524530 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:48.524578 (+ 48us) server_negotiation.cc:407] Connection header received
0807 18:47:48.525449 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:48.525474 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:48.525843 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:48.526192 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:48.527024 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:48.527030 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:48.527044 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:48.527057 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:48.527124 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:48.527150 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:48.527270 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:48.527430 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 18:47:48.527584 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":160,"threads_started":1}
I20260807 18:47:48.531368 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:48.532040 1496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53815693ee464a5abdf196e27387ea69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39875 } }
I20260807 18:47:48.532294 1496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 18:47:48.532371 1496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53815693ee464a5abdf196e27387ea69, State: Initialized, Role: FOLLOWER
I20260807 18:47:48.532886 1496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53815693ee464a5abdf196e27387ea69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39875 } }
I20260807 18:47:48.533059 1496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 18:47:48.533128 1496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 18:47:48.533226 1496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:48.534267 1496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53815693ee464a5abdf196e27387ea69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39875 } }
I20260807 18:47:48.534626 1496 leader_election.cc:302] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53815693ee464a5abdf196e27387ea69; no voters:
I20260807 18:47:48.534966 1496 leader_election.cc:288] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 18:47:48.535347 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:48.533536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39899 (local address 127.10.174.254:39875)
0807 18:47:48.533641 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:48.533645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:48.533878 (+ 233us) server_negotiation.cc:407] Connection header received
0807 18:47:48.534013 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:48.534016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:48.534048 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:48.534134 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:48.534870 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:48.534874 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:48.534877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 18:47:48.534888 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:48.534917 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 18:47:48.534933 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:48.535024 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:48.535137 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 18:47:48.535177 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 18:47:48.535372 1507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:48.535779 1507 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [term 1 LEADER]: Becoming Leader. State: Replica: 53815693ee464a5abdf196e27387ea69, State: Running, Role: LEADER
I20260807 18:47:48.536135 1507 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53815693ee464a5abdf196e27387ea69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39875 } }
I20260807 18:47:48.536520 1496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:48.537278 1506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53815693ee464a5abdf196e27387ea69. Latest consensus state: current_term: 1 leader_uuid: "53815693ee464a5abdf196e27387ea69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53815693ee464a5abdf196e27387ea69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39875 } } }
I20260807 18:47:48.537460 1506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:48.537958 1515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:48.537954 1508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53815693ee464a5abdf196e27387ea69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53815693ee464a5abdf196e27387ea69" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 39875 } } }
I20260807 18:47:48.538058 1508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69 [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:48.541095 1515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:48.546614 1515 catalog_manager.cc:1347] Generated new cluster ID: fd2eceafe010454f84b457f7bebbe159
I20260807 18:47:48.546682 1515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:48.555836 1515 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:48.556197 1515 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:48.566205 1515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53815693ee464a5abdf196e27387ea69: Generated new TSK 0
I20260807 18:47:48.566908 1515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 18:47:48.571954 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1426
2026-08-07T18:47:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1412 ms)
[----------] 18 tests from AuthTokenIssuingTest (26085 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:48 dist-test-slave-07c2 krb5kdc[1527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:48 dist-test-slave-07c2 krb5kdc[1527](info): set up 2 sockets
Aug 07 18:47:48 dist-test-slave-07c2 krb5kdc[1527](info): commencing operation
krb5kdc: starting...
W20260807 18:47:49.639029 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:49 dist-test-slave-07c2 krb5kdc[1527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:49.766057 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33301
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:33301,127.10.174.253:43681,127.10.174.252:38515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:49.873920 1540 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 18:47:49.874197 1540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:49.874219 1540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:49.874310 1540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:49.878278 1540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:49.878330 1540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:49.878350 1540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:49.878365 1540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:49.878381 1540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:49.883478 1540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:33301,127.10.174.253:43681,127.10.174.252:38515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:33301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:49.884500 1540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:49.885489 1540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:49.894035 1548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:49.894081 1545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:49.894075 1546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:49.894418 1540 server_base.cc:1034] running on GCE node
I20260807 18:47:49.894979 1540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:49.896278 1540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:49.897469 1540 hybrid_clock.cc:648] HybridClock initialized: now 1786128469897457 us; error 26 us; skew 500 ppm
Aug 07 18:47:49 dist-test-slave-07c2 krb5kdc[1527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:49.909192 1540 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:49.910132 1540 webserver.cc:460] Webserver started at http://127.10.174.254:37161/ using document root <none> and password file <none>
I20260807 18:47:49.910682 1540 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:49.910740 1540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:49.910919 1540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:49.913056 1540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "e49e79a919634ab1bf82997013c3c80c"
format_stamp: "Formatted at 2026-08-07 18:47:49 on dist-test-slave-07c2"
server_key: "df74bb42e80c606aa6699c3d97c0ddf1"
server_key_iv: "6df82671c17622acb92e563a3061fb02"
server_key_version: "encryptionkey@0"
I20260807 18:47:49.913597 1540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "e49e79a919634ab1bf82997013c3c80c"
format_stamp: "Formatted at 2026-08-07 18:47:49 on dist-test-slave-07c2"
server_key: "df74bb42e80c606aa6699c3d97c0ddf1"
server_key_iv: "6df82671c17622acb92e563a3061fb02"
server_key_version: "encryptionkey@0"
I20260807 18:47:49.917351 1540 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 18:47:49.919690 1555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:49.921234 1540 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 18:47:49.921386 1540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "e49e79a919634ab1bf82997013c3c80c"
format_stamp: "Formatted at 2026-08-07 18:47:49 on dist-test-slave-07c2"
server_key: "df74bb42e80c606aa6699c3d97c0ddf1"
server_key_iv: "6df82671c17622acb92e563a3061fb02"
server_key_version: "encryptionkey@0"
I20260807 18:47:49.921489 1540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:49.941956 1540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:49.944885 1540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:49.945089 1540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:49.952236 1540 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:33301
I20260807 18:47:49.952560 1609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:33301 every 8 connection(s)
I20260807 18:47:49.953186 1540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:49.955940 1610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:49.959594 1610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:49.962950 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1540
I20260807 18:47:49.963081 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:49.963469 10939 external_mini_cluster.cc:1428] Setting key f55e9168c2264a408c43b617bdeaf7db
Aug 07 18:47:49 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.253@KRBTEST.COM" created.
I20260807 18:47:49.975181 1613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:49.962395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44158 (local address 127.10.174.254:33301)
0807 18:47:49.962664 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:49.962673 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:49.962707 (+ 34us) server_negotiation.cc:407] Connection header received
0807 18:47:49.963489 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:49.963493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:49.963705 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:49.963863 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:49.964999 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:49.966238 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:49.967276 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:49.967671 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:49.967879 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:49.970332 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:49.970337 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:49.970347 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:49.970367 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:49.972034 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:49.972545 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:49.972558 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:49.972560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:49.972661 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:49.972979 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:49.972984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:49.972986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:49.973356 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:49.973502 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:49.973868 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 18:47:49.974128 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":171,"thread_start_us":102,"threads_started":1}
I20260807 18:47:49.975181 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:49.961686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33301 (local address 127.0.0.1:44158)
0807 18:47:49.962140 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:49.962181 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:49.963172 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:49.963928 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:49.963937 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:49.964428 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:49.964830 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:49.964852 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:49.966382 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:49.966384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:49.967150 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:49.967159 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:49.967827 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:49.967830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:49.968014 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:49.968730 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:49.968746 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:49.970177 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:49.972155 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:49.972166 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:49.972176 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:49.972436 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:49.972764 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:49.972767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:49.972769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:49.972883 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:49.973475 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:49.973481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:49.973627 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 18:47:49.973799 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 18:47:49.974175 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":156,"thread_start_us":126,"threads_started":1}
I20260807 18:47:49.978567 1610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:49.979336 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:49.979028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42156)
0807 18:47:49.979154 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:49.979227 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 18:47:49.979562 1558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
I20260807 18:47:49.980370 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:49.980157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42168)
0807 18:47:49.980265 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:49.980309 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 18:47:49.980545 1610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:43681: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab.
Entry for principal kudu/127.10.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab.
I20260807 18:47:49.992578 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:43681
--webserver_interface=127.10.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab
--principal=kudu/127.10.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:33301,127.10.174.253:43681,127.10.174.252:38515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:47:50.029771 1610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } attempt: 1
I20260807 18:47:50.030725 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.030353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42174)
0807 18:47:50.030541 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.030628 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 18:47:50.031646 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.031398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42184)
0807 18:47:50.031516 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.031574 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 18:47:50.031796 1610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:43681: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
I20260807 18:47:50.099967 1610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } attempt: 2
I20260807 18:47:50.100911 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.100562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42188)
0807 18:47:50.100743 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.100820 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 18:47:50.101719 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.101450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42192)
0807 18:47:50.101584 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.101647 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 18:47:50.101889 1610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:43681: Network error: Client connection negotiation failed: client connection to 127.10.174.253:43681: connect: Connection refused (error 111)
W20260807 18:47:50.107776 1617 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 18:47:50.108063 1617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:50.108119 1617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:50.108188 1617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:50.112406 1617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:50.112462 1617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:50.112483 1617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:50.112498 1617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:50.112548 1617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:50.118003 1617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:33301,127.10.174.253:43681,127.10.174.252:38515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab
--principal=kudu/127.10.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:43681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:50.119172 1617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:50.120230 1617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:50.128906 1622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:50.128954 1617 server_base.cc:1034] running on GCE node
W20260807 18:47:50.128899 1625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:50.128899 1623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:50.129832 1617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:50.130944 1617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:50.132133 1617 hybrid_clock.cc:648] HybridClock initialized: now 1786128470132100 us; error 46 us; skew 500 ppm
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:50.134884 1617 init.cc:377] Logged in from keytab as kudu/127.10.174.253@KRBTEST.COM (short username kudu)
I20260807 18:47:50.135773 1617 webserver.cc:460] Webserver started at http://127.10.174.253:41655/ using document root <none> and password file <none>
I20260807 18:47:50.136274 1617 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:50.136333 1617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:50.136494 1617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:50.138460 1617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data/instance:
uuid: "51d33fb6d7a64bb8b9a586ea305f9834"
format_stamp: "Formatted at 2026-08-07 18:47:50 on dist-test-slave-07c2"
server_key: "15de2c8e9aca1948a538aac7a63109e5"
server_key_iv: "51ff449bd6a0239749ed7caf9ba7d8fa"
server_key_version: "encryptionkey@0"
I20260807 18:47:50.138980 1617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal/instance:
uuid: "51d33fb6d7a64bb8b9a586ea305f9834"
format_stamp: "Formatted at 2026-08-07 18:47:50 on dist-test-slave-07c2"
server_key: "15de2c8e9aca1948a538aac7a63109e5"
server_key_iv: "51ff449bd6a0239749ed7caf9ba7d8fa"
server_key_version: "encryptionkey@0"
I20260807 18:47:50.142630 1617 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 18:47:50.145051 1632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:50.146272 1617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 18:47:50.146381 1617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal
uuid: "51d33fb6d7a64bb8b9a586ea305f9834"
format_stamp: "Formatted at 2026-08-07 18:47:50 on dist-test-slave-07c2"
server_key: "15de2c8e9aca1948a538aac7a63109e5"
server_key_iv: "51ff449bd6a0239749ed7caf9ba7d8fa"
server_key_version: "encryptionkey@0"
I20260807 18:47:50.146473 1617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:50.174768 1617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:50.177716 1617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:50.177896 1617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:50.185185 1617 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.253:43681
I20260807 18:47:50.185485 1687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.253:43681 every 8 connection(s)
I20260807 18:47:50.186183 1617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
I20260807 18:47:50.188992 1688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:50.190321 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1617
I20260807 18:47:50.190428 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-1/wal/instance
I20260807 18:47:50.190711 10939 external_mini_cluster.cc:1428] Setting key 3ff406a4b0e033628f1280ed8c1b23cf
I20260807 18:47:50.193066 1610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } attempt: 3
I20260807 18:47:50.192977 1688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.174.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.252@KRBTEST.COM" created.
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:50.211345 1613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.195039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44174 (local address 127.10.174.254:33301)
0807 18:47:50.195151 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.195155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.195561 (+ 406us) server_negotiation.cc:407] Connection header received
0807 18:47:50.196201 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.196207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.196298 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.196387 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.198000 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.199672 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.200807 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.201182 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.201648 (+ 466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.207275 (+ 5627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.207279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.207282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.207352 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.208962 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.209610 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.209614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.209618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.209698 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.210150 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.210154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.210155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.210383 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.210487 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.210992 (+ 505us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.211137 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":49}
I20260807 18:47:50.212167 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.193689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42206)
0807 18:47:50.193908 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.193924 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.194022 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.196475 (+ 2453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.196478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.196716 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.196823 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.196829 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.198925 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.198931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.199716 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.199728 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.200933 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.200940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.201072 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.201676 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.201697 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.206390 (+ 4693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.209186 (+ 2796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.209191 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.209193 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.209407 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.209876 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.209879 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.209881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.209968 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.210739 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.210742 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.210843 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.210972 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.212009 (+ 1037us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":899,"spinlock_wait_cycles":4864}
I20260807 18:47:50.212462 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.194970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33301 (local address 127.0.0.1:44174)
0807 18:47:50.195415 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.195471 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.195959 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.196598 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.196611 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.197160 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.197802 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.197823 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.199923 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.199928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.200666 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.200677 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.201404 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.201409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.201542 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.202152 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.202169 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.207068 (+ 4899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.209100 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.209115 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.209131 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.209489 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.209824 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.209829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.209833 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.210000 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.210509 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.210519 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.210711 (+ 192us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.210924 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.211338 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":2,"thread_start_us":150,"threads_started":1}
I20260807 18:47:50.212476 1691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.194363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42206 (local address 127.10.174.253:43681)
0807 18:47:50.194837 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.194879 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.194924 (+ 45us) server_negotiation.cc:407] Connection header received
0807 18:47:50.195959 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.195982 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.196234 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.197049 (+ 815us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.197649 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.198798 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.199980 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.200800 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.201185 (+ 385us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.206650 (+ 5465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.206663 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.206686 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.206737 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.209034 (+ 2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.209533 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.209544 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.209577 (+ 33us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.209781 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.210063 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.210066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.210068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.210629 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.210774 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.211174 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.211406 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":145,"server-negotiator.queue_time_us":324,"spinlock_wait_cycles":16640,"thread_start_us":137,"threads_started":1}
I20260807 18:47:50.214077 1688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:50.214694 1610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:50.215515 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.215151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50394)
0807 18:47:50.215388 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.215443 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260807 18:47:50.216224 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.215981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50408)
0807 18:47:50.216119 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.216168 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260807 18:47:50.216380 1610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:38515: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:47:50.224311 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.214649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42210)
0807 18:47:50.215004 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.215020 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.215116 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.215423 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.215427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.215638 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.215782 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.215791 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.216862 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.216865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.217442 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.217451 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.217903 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.217905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.217981 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.218478 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.218490 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.220486 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.222500 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.222505 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.222510 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.222732 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.223042 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.223044 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.223046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.223356 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.223820 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.223823 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.223915 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.224018 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.224159 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278}
I20260807 18:47:50.224541 1691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.214883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42210 (local address 127.10.174.253:43681)
0807 18:47:50.215002 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.215006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.215069 (+ 63us) server_negotiation.cc:407] Connection header received
0807 18:47:50.215212 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.215217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.215266 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.215378 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.215917 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.216740 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.217572 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.217798 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.217882 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.220643 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.220645 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.220647 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.220669 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.222350 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.222846 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.222849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.222850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.222930 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.223483 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.223486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.223488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.223691 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.223788 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.224208 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.224325 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 18:47:50.225557 1688 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:50.226457 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.226173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50416)
0807 18:47:50.226300 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.226398 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab.
Entry for principal kudu/127.10.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab.
W20260807 18:47:50.227032 1636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
I20260807 18:47:50.228060 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.227843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50430)
0807 18:47:50.227953 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.228006 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 18:47:50.228042 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:38515
--webserver_interface=127.10.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab
--principal=kudu/127.10.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:33301,127.10.174.253:43681,127.10.174.252:38515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:50.228238 1688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:38515: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
I20260807 18:47:50.247550 1610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } attempt: 1
I20260807 18:47:50.248440 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.248125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50446)
0807 18:47:50.248296 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.248362 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 18:47:50.249235 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.249007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50454)
0807 18:47:50.249119 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.249169 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 18:47:50.249400 1610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:38515: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
I20260807 18:47:50.277578 1688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } attempt: 1
I20260807 18:47:50.278694 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.278340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50466)
0807 18:47:50.278531 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.278611 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 18:47:50.279592 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.279378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50476)
0807 18:47:50.279479 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.279530 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 18:47:50.279767 1688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:38515: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
I20260807 18:47:50.324601 1610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } attempt: 2
I20260807 18:47:50.325553 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.325194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50490)
0807 18:47:50.325383 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.325457 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 18:47:50.326342 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.326081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50500)
0807 18:47:50.326200 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.326257 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 18:47:50.326534 1610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:38515: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
W20260807 18:47:50.343720 1695 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 18:47:50.344002 1695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:50.344025 1695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:50.344103 1695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 18:47:50.347957 1688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } attempt: 2
W20260807 18:47:50.348488 1695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:50.348578 1695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:50.348609 1695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:50.348632 1695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:50.348718 1695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:50.348908 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.348547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50502)
0807 18:47:50.348729 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.348825 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 18:47:50.349728 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.349472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50508)
0807 18:47:50.349597 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.349650 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 18:47:50.349931 1688 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:38515: Network error: Client connection negotiation failed: client connection to 127.10.174.252:38515: connect: Connection refused (error 111)
I20260807 18:47:50.354679 1695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:33301,127.10.174.253:43681,127.10.174.252:38515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab
--principal=kudu/127.10.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:38515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:50.355757 1695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:50.356734 1695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:50.365005 1704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:50.365015 1700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:50.365172 1702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:50.365803 1695 server_base.cc:1034] running on GCE node
I20260807 18:47:50.366320 1695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:50.367374 1695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:50.368651 1695 hybrid_clock.cc:648] HybridClock initialized: now 1786128470368634 us; error 35 us; skew 500 ppm
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:50.371531 1695 init.cc:377] Logged in from keytab as kudu/127.10.174.252@KRBTEST.COM (short username kudu)
I20260807 18:47:50.372493 1695 webserver.cc:460] Webserver started at http://127.10.174.252:40327/ using document root <none> and password file <none>
I20260807 18:47:50.373064 1695 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:50.373127 1695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:50.373351 1695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:50.375468 1695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data/instance:
uuid: "c13f39b905964bebaa8a1a5e768ad043"
format_stamp: "Formatted at 2026-08-07 18:47:50 on dist-test-slave-07c2"
server_key: "5cc137f455565c98e3995b0b8702357a"
server_key_iv: "b7596787420675b94df63d221200ce3a"
server_key_version: "encryptionkey@0"
I20260807 18:47:50.376062 1695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal/instance:
uuid: "c13f39b905964bebaa8a1a5e768ad043"
format_stamp: "Formatted at 2026-08-07 18:47:50 on dist-test-slave-07c2"
server_key: "5cc137f455565c98e3995b0b8702357a"
server_key_iv: "b7596787420675b94df63d221200ce3a"
server_key_version: "encryptionkey@0"
I20260807 18:47:50.379650 1695 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 18:47:50.381929 1712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:50.383033 1695 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:50.383157 1695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal
uuid: "c13f39b905964bebaa8a1a5e768ad043"
format_stamp: "Formatted at 2026-08-07 18:47:50 on dist-test-slave-07c2"
server_key: "5cc137f455565c98e3995b0b8702357a"
server_key_iv: "b7596787420675b94df63d221200ce3a"
server_key_version: "encryptionkey@0"
I20260807 18:47:50.383260 1695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:50.407945 1695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:50.411454 1695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:50.411674 1695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:50.419056 1695 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.252:38515
I20260807 18:47:50.419378 1766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.252:38515 every 8 connection(s)
I20260807 18:47:50.420267 1695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
I20260807 18:47:50.423127 1767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:50.425747 1610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } attempt: 3
I20260807 18:47:50.425958 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1695
I20260807 18:47:50.426093 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786128190976416-10939-0/minicluster-data/master-2/wal/instance
I20260807 18:47:50.426448 10939 external_mini_cluster.cc:1428] Setting key 76eb1dde7f7c76b2c9b37121ad281f50
I20260807 18:47:50.427664 1767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:47:50.441165 1688 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } attempt: 3
I20260807 18:47:50.441890 1612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.426294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50522)
0807 18:47:50.426467 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.426488 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.426596 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.429456 (+ 2860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.429460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.429687 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.429861 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.429873 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.432016 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.432019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.432866 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.432878 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.433914 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.434021 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.434613 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.434631 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.436565 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.439829 (+ 3264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.439832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.439835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.440088 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.440426 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440432 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.440437 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.440529 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.441008 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.441012 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.441115 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.441544 (+ 429us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.441705 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"spinlock_wait_cycles":3840}
I20260807 18:47:50.442332 1613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.429455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44186 (local address 127.10.174.254:33301)
0807 18:47:50.429577 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.429581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.429936 (+ 355us) server_negotiation.cc:407] Connection header received
0807 18:47:50.430141 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.430144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.430192 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.430249 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.431255 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.432005 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.432966 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.433204 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433317 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.437919 (+ 4602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.437924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.437928 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.437962 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.439873 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440460 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.440464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.440468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.440529 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440856 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.440860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.440861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.441187 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.441262 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.441725 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.441826 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51,"spinlock_wait_cycles":4096}
I20260807 18:47:50.443446 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.429412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:33301 (local address 127.0.0.1:44186)
0807 18:47:50.429816 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.429863 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.430022 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.430426 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.430431 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.430910 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.431090 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.431103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.432108 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.432111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.432837 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.432845 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.433359 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.433578 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.434315 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.434337 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.437707 (+ 3370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.439991 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440002 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.440009 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.440354 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.440642 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440645 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.440647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.440747 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.441349 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.441355 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.441499 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.441939 (+ 440us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.442325 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":31,"thread_start_us":100,"threads_started":1}
I20260807 18:47:50.443459 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.427279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50522 (local address 127.10.174.252:38515)
0807 18:47:50.427799 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.427816 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.427852 (+ 36us) server_negotiation.cc:407] Connection header received
0807 18:47:50.428668 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.428692 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.429203 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.430115 (+ 912us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.430549 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.431848 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433020 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.433751 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433935 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.436744 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.436770 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.436787 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.436821 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.439689 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440224 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.440227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.440228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.440311 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440648 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.440650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.440652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.440904 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.442518 (+ 1614us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.442591 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.442717 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":217,"server-negotiator.queue_time_us":323,"spinlock_wait_cycles":24320,"thread_start_us":132,"threads_started":1}
I20260807 18:47:50.443465 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.427279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50528 (local address 127.10.174.252:38515)
0807 18:47:50.428004 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.428013 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.428024 (+ 11us) server_negotiation.cc:407] Connection header received
0807 18:47:50.428667 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.428692 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.429127 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.430114 (+ 987us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.430551 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.431805 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433020 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.433750 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.433911 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.437258 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.437263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.437265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.437291 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.439526 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.439987 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.439993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.440001 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.440132 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.440446 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.440450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.440451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.440879 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.441103 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.442416 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.442588 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":757,"server-negotiator.queue_time_us":616,"spinlock_wait_cycles":6912,"thread_start_us":137,"threads_started":1}
I20260807 18:47:50.445326 1767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:50.448238 1610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c: Bootstrap starting.
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:47:50.450711 1610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:50.451709 1610 log.cc:824] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:50.452673 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.441694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50542)
0807 18:47:50.442026 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.442044 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.442141 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.443183 (+ 1042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.443187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.443409 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.443536 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.443548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.444665 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.444668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.445445 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.445457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.446578 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.446582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.446673 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.447157 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.447175 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.448674 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.450794 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.450797 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.450800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.451089 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.451451 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.451454 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.451456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.451559 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.452093 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.452096 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.452210 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.452323 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.452476 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249}
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:50.453452 1774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.441998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50542 (local address 127.10.174.252:38515)
0807 18:47:50.442928 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.442936 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.442950 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:47:50.442984 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.442986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.443029 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.443677 (+ 648us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.443800 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.444528 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.445601 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.446310 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.446456 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.448830 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.448833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.448836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.448860 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.450679 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.451201 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.451206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.451208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.451343 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.451689 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.451695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.451698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.451952 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.452972 (+ 1020us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.453056 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.453251 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":862,"thread_start_us":139,"threads_started":1}
I20260807 18:47:50.453876 1610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c: No bootstrap required, opened a new log
I20260807 18:47:50.456867 1688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: Bootstrap starting.
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:47:50.457746 1613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.446300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44200 (local address 127.10.174.254:33301)
0807 18:47:50.446422 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.446427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.446594 (+ 167us) server_negotiation.cc:407] Connection header received
0807 18:47:50.446709 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.446712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.446749 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.446848 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.447836 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.448314 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.449656 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.450337 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.450431 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.453564 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.453570 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.453574 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.453603 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.455467 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.456287 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.456290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.456292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.456386 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.456720 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.456723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.456725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.456961 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.457111 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.457489 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.457611 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:47:50.458227 1610 raft_consensus.cc:348] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.458503 1610 raft_consensus.cc:729] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49e79a919634ab1bf82997013c3c80c, State: Initialized, Role: FOLLOWER
I20260807 18:47:50.458869 1610 consensus_queue.cc:260] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.459753 1688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:50.460408 1610 sys_catalog.cc:564] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:50.460644 1688 log.cc:824] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:50.461498 1691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.446052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42224 (local address 127.10.174.253:43681)
0807 18:47:50.446151 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.446155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.452339 (+ 6184us) server_negotiation.cc:407] Connection header received
0807 18:47:50.452525 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.452528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.452570 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.452618 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.453484 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.454165 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.455214 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.455560 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.455635 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.457863 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.457867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.457869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.457894 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.459553 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.460036 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.460039 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.460041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.460125 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.460453 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.460456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.460458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.460706 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.460792 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.461173 (+ 381us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.461304 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 18:47:50.462280 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.445807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:43681 (local address 127.0.0.1:42224)
0807 18:47:50.452258 (+ 6451us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.452275 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.452411 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.453005 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.453008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.453254 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.453346 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.453353 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.454314 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.454317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.455059 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.455069 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.455781 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.455787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.455874 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.456291 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.456305 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.457706 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.459679 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.459682 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.459684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.459916 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.460254 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.460256 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.460258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.460344 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.460869 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.460872 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.460970 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.461900 (+ 930us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.462052 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6377}
I20260807 18:47:50.463166 1767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:50.463328 1688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: No bootstrap required, opened a new log
I20260807 18:47:50.463377 1776 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.465416 1776 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: This master's current role is: FOLLOWER
W20260807 18:47:50.466284 1789 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:50.466379 1789 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:50.467697 1688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.468083 1688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d33fb6d7a64bb8b9a586ea305f9834, State: Initialized, Role: FOLLOWER
I20260807 18:47:50.468473 1688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.469919 1688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:50.466202 1540 master_runner.cc:186] Error getting master registration for 127.10.174.253:43681: OK, instance_id { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" instance_seqno: 1786128470183066 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:47:50.472164 1540 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128470, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
Aug 07 18:47:50 dist-test-slave-07c2 krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
W20260807 18:47:50.476998 1802 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:50.477210 1802 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:50.477468 1791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.477690 1791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:50.479374 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.463765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:38515 (local address 127.0.0.1:50546)
0807 18:47:50.465124 (+ 1359us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:50.465150 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:50.465223 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:50.467610 (+ 2387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:50.467613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:50.467791 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:50.467878 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.467886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.468864 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.468867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.469658 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:50.469669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.470332 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.470337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:50.470412 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.470935 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:50.470950 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:50.473158 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:50.476537 (+ 3379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.476541 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.476543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.476821 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.478218 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:50.478221 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:50.478223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:50.478303 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:50.478781 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:50.478785 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:50.478887 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 18:47:50.479000 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 18:47:50.479179 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1287}
I20260807 18:47:50.480180 1774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.463959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.10.174.252:38515)
0807 18:47:50.467428 (+ 3469us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.467431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.467443 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:47:50.467471 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.467473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.467506 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.467601 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.468000 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.468745 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.469785 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.470110 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.470218 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.473309 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.473316 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.473321 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.473344 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.476271 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.478011 (+ 1740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.478014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.478016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.478103 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.478390 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.478393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.478395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.478630 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.478744 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.479890 (+ 1146us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.480016 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3397}
I20260807 18:47:50.482256 1777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.460053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42232 (local address 127.10.174.253:43681)
0807 18:47:50.460646 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.460656 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.460671 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:47:50.460706 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.460709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.460756 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.461642 (+ 886us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.461761 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.462551 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.464005 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.464335 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.472382 (+ 8047us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.476988 (+ 4606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.476992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.476995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.477026 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.479614 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.480206 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.480209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.480211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.480300 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.480646 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.480649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.480650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.480900 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.481842 (+ 942us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.481926 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.482068 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":86,"threads_started":1}
I20260807 18:47:50.483415 1767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: Bootstrap starting.
I20260807 18:47:50.485610 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:50.486299 1767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:50.483268 1617 master_runner.cc:186] Error getting master registration for 127.10.174.252:38515: OK, instance_id { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" instance_seqno: 1786128470417063 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:47:50.486825 1617 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:47:50.487215 1767 log.cc:824] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:50.487200 1584 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e49e79a919634ab1bf82997013c3c80c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44200
I20260807 18:47:50.487625 1584 raft_consensus.cc:482] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 18:47:50.487788 1584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:50.488950 1584 raft_consensus.cc:504] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.489908 1584 leader_election.cc:288] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [CANDIDATE]: Term 1 election: Requested vote from peers 51d33fb6d7a64bb8b9a586ea305f9834 (127.10.174.253:43681), c13f39b905964bebaa8a1a5e768ad043 (127.10.174.252:38515)
I20260807 18:47:50.490417 1660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e49e79a919634ab1bf82997013c3c80c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "51d33fb6d7a64bb8b9a586ea305f9834"
I20260807 18:47:50.490659 1660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:50.492154 1660 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49e79a919634ab1bf82997013c3c80c in term 1.
I20260807 18:47:50.492741 1558 leader_election.cc:302] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d33fb6d7a64bb8b9a586ea305f9834, e49e79a919634ab1bf82997013c3c80c; no voters:
I20260807 18:47:50.493070 1776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:50.493335 1776 raft_consensus.cc:686] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [term 1 LEADER]: Becoming Leader. State: Replica: e49e79a919634ab1bf82997013c3c80c, State: Running, Role: LEADER
I20260807 18:47:50.493713 1776 consensus_queue.cc:237] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.495749 1776 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e49e79a919634ab1bf82997013c3c80c. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.495885 1776 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:50.497394 1767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: No bootstrap required, opened a new log
I20260807 18:47:50.502111 1767 raft_consensus.cc:348] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.502389 1767 raft_consensus.cc:729] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13f39b905964bebaa8a1a5e768ad043, State: Initialized, Role: FOLLOWER
I20260807 18:47:50.502727 1767 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } }
I20260807 18:47:50.503351 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.503687 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:50.504174 1767 sys_catalog.cc:564] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:50.504272 1741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e49e79a919634ab1bf82997013c3c80c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c13f39b905964bebaa8a1a5e768ad043"
I20260807 18:47:50.504477 1741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:50.505719 1741 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e49e79a919634ab1bf82997013c3c80c in term 1.
I20260807 18:47:50.512687 1815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:50.513522 1613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.492970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44206 (local address 127.10.174.254:33301)
0807 18:47:50.493087 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.493094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.495812 (+ 2718us) server_negotiation.cc:407] Connection header received
0807 18:47:50.496169 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.496175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.496228 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.496279 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.497536 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.498044 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.499209 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.499526 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.499644 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.501416 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.501420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.501422 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.501455 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.503192 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.503765 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.503772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.503774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.503890 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.506160 (+ 2270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.506163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.506165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.506441 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.513070 (+ 6629us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.513156 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.513303 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 18:47:50.513646 1815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:50.517128 1774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.494080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.10.174.252:38515)
0807 18:47:50.494191 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.494196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.507442 (+ 13246us) server_negotiation.cc:407] Connection header received
0807 18:47:50.507548 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.507551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.507599 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.507672 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.508562 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.509270 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.510276 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.510582 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.510682 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.512989 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.512994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.512997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.513024 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.515043 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.515594 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.515597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.515599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.515689 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.515997 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.516000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.516001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.516236 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.516389 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.516850 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.516975 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 18:47:50.518456 1828 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:50.518551 1828 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:50.524767 1777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:50.496461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42234 (local address 127.10.174.253:43681)
0807 18:47:50.496589 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.496594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.515892 (+ 19298us) server_negotiation.cc:407] Connection header received
0807 18:47:50.516075 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.516079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.516126 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.516176 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.517362 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.518202 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.519420 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:50.519688 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:50.519814 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:50.521279 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:50.521282 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:50.521285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:50.521317 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:50.522775 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.523206 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.523210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.523211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.523354 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:50.523698 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:50.523702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:50.523703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:50.523910 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:50.524027 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:50.524493 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 18:47:50.524618 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:47:50.527691 1660 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [term 1 FOLLOWER]: Refusing update from remote peer e49e79a919634ab1bf82997013c3c80c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:50.527691 1741 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [term 1 FOLLOWER]: Refusing update from remote peer e49e79a919634ab1bf82997013c3c80c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:50.528381 1809 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:50.528592 1776 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:50.532425 1791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e49e79a919634ab1bf82997013c3c80c. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.532555 1791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:50.532953 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e49e79a919634ab1bf82997013c3c80c. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.533094 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:50.537259 1809 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.537410 1809 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:50.538579 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.538703 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:50.539108 1829 mvcc.cc:205] Tried to move back new op lower bound from 7315982215271464960 to 7315982215146119168. Current Snapshot: MvccSnapshot[applied={T|T < 7315982215271464960}]
I20260807 18:47:50.540808 1776 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.540928 1776 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:50.543208 1791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e49e79a919634ab1bf82997013c3c80c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e49e79a919634ab1bf82997013c3c80c" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 33301 } } peers { permanent_uuid: "51d33fb6d7a64bb8b9a586ea305f9834" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 43681 } } peers { permanent_uuid: "c13f39b905964bebaa8a1a5e768ad043" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 38515 } } }
I20260807 18:47:50.543361 1791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:50.544691 1815 catalog_manager.cc:1347] Generated new cluster ID: 2e869033aca4489ebcbd6ed168203637
I20260807 18:47:50.544757 1815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:50.547498 1832 mvcc.cc:205] Tried to move back new op lower bound from 7315982215271464960 to 7315982215146119168. Current Snapshot: MvccSnapshot[applied={T|T < 7315982215271464960}]
I20260807 18:47:50.583899 1815 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:50.585218 1815 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:50.599045 1815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e49e79a919634ab1bf82997013c3c80c: Generated new TSK 0
I20260807 18:47:50.599944 1815 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 18:47:50.628176 1613 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.624843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44216 (local address 127.10.174.254:33301)
0807 18:47:50.624983 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.624987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.626804 (+ 1817us) server_negotiation.cc:407] Connection header received
0807 18:47:50.627331 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.627335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.627384 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.627437 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.628042 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44216: BlockingRecv error: recv got EOF from 127.0.0.1:44216 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 18:47:50.629082 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.625626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50564 (local address 127.10.174.252:38515)
0807 18:47:50.625758 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.625762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.627142 (+ 1380us) server_negotiation.cc:407] Connection header received
0807 18:47:50.627277 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.627281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.627362 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.627449 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.628961 (+ 1512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50564: BlockingRecv error: recv got EOF from 127.0.0.1:50564 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 18:47:50.629519 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.626308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.10.174.253:43681)
0807 18:47:50.626442 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.626447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.628685 (+ 2238us) server_negotiation.cc:407] Connection header received
0807 18:47:50.628846 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.628849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.628894 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.628942 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.629400 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42248: BlockingRecv error: recv got EOF from 127.0.0.1:42248 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 18:47:50.633304 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.631877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42252 (local address 127.10.174.253:43681)
0807 18:47:50.631968 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.631971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.632408 (+ 437us) server_negotiation.cc:407] Connection header received
0807 18:47:50.632621 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.632624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.632691 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.632742 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.633218 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42252: BlockingRecv error: recv got EOF from 127.0.0.1:42252 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 18:47:50.638302 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.637039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42264 (local address 127.10.174.253:43681)
0807 18:47:50.637147 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.637151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.637459 (+ 308us) server_negotiation.cc:407] Connection header received
0807 18:47:50.637639 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.637642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.637689 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.637740 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.638218 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42264: BlockingRecv error: recv got EOF from 127.0.0.1:42264 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 18:47:50.643895 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.642345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42270 (local address 127.10.174.253:43681)
0807 18:47:50.642437 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.642441 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.642890 (+ 449us) server_negotiation.cc:407] Connection header received
0807 18:47:50.643082 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.643086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.643136 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.643200 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.643806 (+ 606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42270: BlockingRecv error: recv got EOF from 127.0.0.1:42270 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 18:47:50.651754 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.650020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42274 (local address 127.10.174.253:43681)
0807 18:47:50.650167 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.650171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.650700 (+ 529us) server_negotiation.cc:407] Connection header received
0807 18:47:50.650933 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.650937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.650988 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.651038 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.651660 (+ 622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42274: BlockingRecv error: recv got EOF from 127.0.0.1:42274 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 18:47:50.664814 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.662232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42284 (local address 127.10.174.253:43681)
0807 18:47:50.662347 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.662351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.662892 (+ 541us) server_negotiation.cc:407] Connection header received
0807 18:47:50.664012 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.664015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.664072 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.664127 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.664703 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42284: BlockingRecv error: recv got EOF from 127.0.0.1:42284 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 18:47:50.685417 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.683563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42298 (local address 127.10.174.253:43681)
0807 18:47:50.683689 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.683694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.684375 (+ 681us) server_negotiation.cc:407] Connection header received
0807 18:47:50.684597 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.684601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.684658 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.684719 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.685298 (+ 579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42298: BlockingRecv error: recv got EOF from 127.0.0.1:42298 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 18:47:50.721803 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.720502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42304 (local address 127.10.174.253:43681)
0807 18:47:50.720667 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.720673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.720854 (+ 181us) server_negotiation.cc:407] Connection header received
0807 18:47:50.721036 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.721039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.721088 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.721186 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.721660 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42304: BlockingRecv error: recv got EOF from 127.0.0.1:42304 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 18:47:50.789366 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.788320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42312 (local address 127.10.174.253:43681)
0807 18:47:50.788466 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.788470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.788569 (+ 99us) server_negotiation.cc:407] Connection header received
0807 18:47:50.788712 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.788715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.788765 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.788851 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.789249 (+ 398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42312: BlockingRecv error: recv got EOF from 127.0.0.1:42312 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 18:47:50.920910 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:50.919605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42320 (local address 127.10.174.253:43681)
0807 18:47:50.919814 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:50.919819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:50.919945 (+ 126us) server_negotiation.cc:407] Connection header received
0807 18:47:50.920141 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:50.920145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:50.920193 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:50.920286 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:50.920809 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42320: BlockingRecv error: recv got EOF from 127.0.0.1:42320 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260807 18:47:51.180666 1777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:51.179274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.10.174.253:43681)
0807 18:47:51.179450 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:51.179454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:51.179647 (+ 193us) server_negotiation.cc:407] Connection header received
0807 18:47:51.179827 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:51.179829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:51.179908 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:51.179996 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:51.180511 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42336: BlockingRecv error: recv got EOF from 127.0.0.1:42336 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 18:47:51.478564 1802 catalog_manager.cc:1259] Loaded cluster ID: 2e869033aca4489ebcbd6ed168203637
I20260807 18:47:51.478657 1802 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: loading cluster ID for follower catalog manager: success
I20260807 18:47:51.480374 1802 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: acquiring CA information for follower catalog manager: success
I20260807 18:47:51.481524 1802 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 51d33fb6d7a64bb8b9a586ea305f9834: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:47:51.520066 1828 catalog_manager.cc:1259] Loaded cluster ID: 2e869033aca4489ebcbd6ed168203637
I20260807 18:47:51.520152 1828 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: loading cluster ID for follower catalog manager: success
I20260807 18:47:51.521842 1828 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: acquiring CA information for follower catalog manager: success
I20260807 18:47:51.523002 1828 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c13f39b905964bebaa8a1a5e768ad043: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:47:51.698938 1906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:51.694922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42342 (local address 127.10.174.253:43681)
0807 18:47:51.695186 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:51.695190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:51.695207 (+ 17us) server_negotiation.cc:407] Connection header received
0807 18:47:51.695398 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:51.695401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:51.695522 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:51.695627 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:51.695916 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.696447 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.697380 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.697619 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.697705 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:51.698015 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:51.698453 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:51.698545 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:51.698699 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 18:47:51.698762 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
I20260807 18:47:51.706905 1912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:51.702557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.10.174.252:38515)
0807 18:47:51.702858 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:51.702862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:51.702877 (+ 15us) server_negotiation.cc:407] Connection header received
0807 18:47:51.702966 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:51.702969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:51.703092 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:51.703204 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:51.703498 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.704074 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.705199 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.705533 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.705626 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:51.706037 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:51.706488 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:51.706586 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:51.706699 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 18:47:51.706759 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":114,"threads_started":1}
I20260807 18:47:51.714395 1906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:51.710500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42350 (local address 127.10.174.253:43681)
0807 18:47:51.710658 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:51.710664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:51.710741 (+ 77us) server_negotiation.cc:407] Connection header received
0807 18:47:51.710993 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:51.710996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:51.711075 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:51.711162 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:51.711458 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.712157 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.713151 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.713494 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.713608 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:51.713900 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:51.713990 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:51.714079 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:51.714177 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 18:47:51.714233 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 18:47:51.714942 1912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:51.710890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.10.174.252:38515)
0807 18:47:51.711002 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:51.711006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:51.711245 (+ 239us) server_negotiation.cc:407] Connection header received
0807 18:47:51.711541 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:51.711544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:51.711606 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:51.711680 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:51.711955 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.712765 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.713707 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.714031 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.714119 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:51.714462 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:51.714538 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:51.714587 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:51.714760 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 18:47:51.714820 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 18:47:51.715858 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:51.710414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44232 (local address 127.10.174.254:33301)
0807 18:47:51.710813 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:51.710818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:51.711061 (+ 243us) server_negotiation.cc:407] Connection header received
0807 18:47:51.711333 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:51.711337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:51.711526 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:51.711647 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:51.712048 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.712835 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.713949 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:51.714286 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:51.714395 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:51.714966 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:51.715394 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:51.715491 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:51.715630 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 18:47:51.715698 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":74,"threads_started":1}
I20260807 18:47:51.719151 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1540
I20260807 18:47:51.727358 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1617
I20260807 18:47:51.734786 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1695
2026-08-07T18:47:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3164 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 18:47:51 dist-test-slave-07c2 krb5kdc[1923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 18:47:51 dist-test-slave-07c2 krb5kdc[1923](info): set up 2 sockets
Aug 07 18:47:51 dist-test-slave-07c2 krb5kdc[1923](info): commencing operation
krb5kdc: starting...
W20260807 18:47:52.810909 10939 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/test-user.keytab.
Aug 07 18:47:52 dist-test-slave-07c2 krb5kdc[1923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T18:47:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T18:47:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
Entry for principal kudu/127.10.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab.
I20260807 18:47:52.934643 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43555
--webserver_interface=127.10.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43555,127.10.174.253:35387,127.10.174.252:39721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 18:47:53.048399 1936 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 18:47:53.048725 1936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:53.048751 1936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:53.048867 1936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:53.053031 1936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:53.053092 1936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:53.053110 1936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:53.053128 1936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:53.053172 1936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:53.058578 1936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43555,127.10.174.253:35387,127.10.174.252:39721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.254.keytab
--principal=kudu/127.10.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.254:43555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:53.059688 1936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:53.060761 1936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:53.069281 1944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:53.069293 1941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:53.069416 1942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:53.069543 1936 server_base.cc:1034] running on GCE node
I20260807 18:47:53.070333 1936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:53.071612 1936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:53.072808 1936 hybrid_clock.cc:648] HybridClock initialized: now 1786128473072795 us; error 27 us; skew 500 ppm
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:53.075595 1936 init.cc:377] Logged in from keytab as kudu/127.10.174.254@KRBTEST.COM (short username kudu)
I20260807 18:47:53.076490 1936 webserver.cc:460] Webserver started at http://127.10.174.254:33655/ using document root <none> and password file <none>
I20260807 18:47:53.077062 1936 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:53.077160 1936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:53.077404 1936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:53.079579 1936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data/instance:
uuid: "fd13bbba716648978b0b20c40db2d8fe"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "73d6b4dc8b5539e9bfe92a91c6fdf7d9"
server_key_iv: "6c59afcdb301c58938d47ab232a805e1"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.080166 1936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal/instance:
uuid: "fd13bbba716648978b0b20c40db2d8fe"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "73d6b4dc8b5539e9bfe92a91c6fdf7d9"
server_key_iv: "6c59afcdb301c58938d47ab232a805e1"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.084183 1936 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 18:47:53.086678 1952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:53.087960 1936 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:53.088126 1936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal
uuid: "fd13bbba716648978b0b20c40db2d8fe"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "73d6b4dc8b5539e9bfe92a91c6fdf7d9"
server_key_iv: "6c59afcdb301c58938d47ab232a805e1"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.088249 1936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:53.098933 1936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:53.101913 1936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:53.102121 1936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:53.109385 1936 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.254:43555
I20260807 18:47:53.109694 2005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.254:43555 every 8 connection(s)
I20260807 18:47:53.110534 1936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/data/info.pb
I20260807 18:47:53.111990 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 1936
I20260807 18:47:53.112130 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-0/wal/instance
I20260807 18:47:53.112419 10939 external_mini_cluster.cc:1428] Setting key 59fc9ef6a17f13c395c300bbecd7ddf3
I20260807 18:47:53.113533 2006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:53.119025 2006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.253@KRBTEST.COM" created.
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:53.135962 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.121490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43555 (local address 127.0.0.1:52520)
0807 18:47:53.122136 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.122185 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.123063 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.123852 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.123860 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.124296 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.124610 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.124625 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.125808 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.125814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.126803 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.126812 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.127775 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.127779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.127947 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.128592 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.128608 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.130405 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.132841 (+ 2436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.132850 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.132858 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.133088 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.133486 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.133489 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.133490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.133602 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.134339 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.134344 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.134471 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.134683 (+ 212us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.135086 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":142,"spinlock_wait_cycles":51584,"thread_start_us":181,"threads_started":1}
I20260807 18:47:53.135965 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.121490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.10.174.254:43555)
0807 18:47:53.122108 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.122129 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.122300 (+ 171us) server_negotiation.cc:407] Connection header received
0807 18:47:53.123397 (+ 1097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.123402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.123597 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.123758 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.124785 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.125667 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.126942 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.127605 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.127905 (+ 300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.130582 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.130591 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.130609 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.130654 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.132730 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.133216 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.133225 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.133229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.133381 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.133697 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.133702 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.133705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.134222 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.134327 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.134757 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.135004 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":437,"spinlock_wait_cycles":4480,"thread_start_us":153,"threads_started":1}
I20260807 18:47:53.138451 2006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:53.139472 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.139087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58772)
0807 18:47:53.139279 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.139404 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260807 18:47:53.139735 1955 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
I20260807 18:47:53.140787 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.140514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58786)
0807 18:47:53.140618 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.140695 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 18:47:53.140959 2006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:35387: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab.
Entry for principal kudu/127.10.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab.
I20260807 18:47:53.142211 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:35387
--webserver_interface=127.10.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab
--principal=kudu/127.10.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43555,127.10.174.253:35387,127.10.174.252:39721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:47:53.190267 2006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } attempt: 1
I20260807 18:47:53.191241 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.190881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58794)
0807 18:47:53.191066 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.191145 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 18:47:53.192123 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.191873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58804)
0807 18:47:53.192002 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.192054 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 18:47:53.192298 2006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:35387: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
W20260807 18:47:53.254511 2014 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 18:47:53.254797 2014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:53.254849 2014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:53.254928 2014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 18:47:53.259089 2014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:53.259155 2014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:53.259174 2014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:53.259191 2014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:53.259207 2014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:53.260473 2006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } attempt: 2
I20260807 18:47:53.261361 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.261023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58814)
0807 18:47:53.261196 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.261269 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 18:47:53.262100 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.261880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58830)
0807 18:47:53.261985 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.262036 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 18:47:53.262239 2006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.253:35387: Network error: Client connection negotiation failed: client connection to 127.10.174.253:35387: connect: Connection refused (error 111)
I20260807 18:47:53.265331 2014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43555,127.10.174.253:35387,127.10.174.252:39721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.253.keytab
--principal=kudu/127.10.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.253:35387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:53.266408 2014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:53.267513 2014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:53.276084 2020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:53.276108 2019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:53.276274 2022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:53.276314 2014 server_base.cc:1034] running on GCE node
I20260807 18:47:53.276934 2014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:53.278029 2014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:53.279213 2014 hybrid_clock.cc:648] HybridClock initialized: now 1786128473279179 us; error 47 us; skew 500 ppm
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:53.282104 2014 init.cc:377] Logged in from keytab as kudu/127.10.174.253@KRBTEST.COM (short username kudu)
I20260807 18:47:53.283041 2014 webserver.cc:460] Webserver started at http://127.10.174.253:35007/ using document root <none> and password file <none>
I20260807 18:47:53.283677 2014 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:53.283780 2014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:53.284017 2014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:53.286334 2014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data/instance:
uuid: "dfb7d32c26f446a2a6b03b67abc2847a"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "126190f6cb6b9ea9c205bb36fe91169a"
server_key_iv: "5766a2dc7e7d3ecab185176ff5ad87fa"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.287117 2014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal/instance:
uuid: "dfb7d32c26f446a2a6b03b67abc2847a"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "126190f6cb6b9ea9c205bb36fe91169a"
server_key_iv: "5766a2dc7e7d3ecab185176ff5ad87fa"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.291113 2014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 18:47:53.293843 2029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:53.295130 2014 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 18:47:53.295341 2014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal
uuid: "dfb7d32c26f446a2a6b03b67abc2847a"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "126190f6cb6b9ea9c205bb36fe91169a"
server_key_iv: "5766a2dc7e7d3ecab185176ff5ad87fa"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.295477 2014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:53.309545 2014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:53.313020 2014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:53.313236 2014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:53.320557 2014 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.253:35387
I20260807 18:47:53.320858 2083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.253:35387 every 8 connection(s)
I20260807 18:47:53.321554 2014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/data/info.pb
I20260807 18:47:53.324347 2084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:53.328030 2084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:53.329464 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 2014
I20260807 18:47:53.329622 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-1/wal/instance
I20260807 18:47:53.329958 10939 external_mini_cluster.cc:1428] Setting key 384bbadce141b483e82f911cd4bb3cb0
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.174.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.174.252@KRBTEST.COM" created.
I20260807 18:47:53.342097 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.330053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.10.174.254:43555)
0807 18:47:53.330213 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.330218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.331072 (+ 854us) server_negotiation.cc:407] Connection header received
0807 18:47:53.332085 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.332088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.332161 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.332268 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.333418 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.333955 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.335165 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.335480 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.335594 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.338064 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.338068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.338071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.338104 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.339693 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.340290 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.340294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.340295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.340383 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.340848 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.340855 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.340859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.341064 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.341177 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.341842 (+ 665us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.341963 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 18:47:53.343235 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.330415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43555 (local address 127.0.0.1:52524)
0807 18:47:53.330897 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.330951 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.331863 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.332438 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.332444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.332806 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.333266 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.333281 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.334092 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.334101 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.335031 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.335041 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.335648 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.335652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.335828 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.336449 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.336465 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.337890 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.339820 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.339827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.339841 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.340171 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.340481 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.340484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.340486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.340686 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.341189 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.341196 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.341552 (+ 356us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.341782 (+ 230us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.342151 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":140,"threads_started":1}
I20260807 18:47:53.344791 2084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:47:53.353384 2006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } attempt: 3
I20260807 18:47:53.356715 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.345343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58834)
0807 18:47:53.345479 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.345494 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.345576 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.346172 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.346175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.346378 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.346456 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.346462 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.347568 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.347572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.348163 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.348171 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.348829 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.348832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.348965 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.349530 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.349542 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.352395 (+ 2853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.354870 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.354877 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.354881 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.355090 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.355510 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.355515 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.355517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.355607 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.356112 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.356115 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.356206 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.356339 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.356480 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":25}
I20260807 18:47:53.357484 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.345494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.10.174.253:35387)
0807 18:47:53.345805 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.345814 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.345833 (+ 19us) server_negotiation.cc:407] Connection header received
0807 18:47:53.345866 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.345871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.346020 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.346176 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.346573 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.347437 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.348289 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.348704 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.348833 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.352575 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.352587 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.352600 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.352627 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.354747 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.355210 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.355220 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.355225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.355409 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.355720 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.355724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.355725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.355997 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.356167 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.356432 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.356571 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":227,"thread_start_us":103,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab.
Entry for principal kudu/127.10.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab.
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
I20260807 18:47:53.359655 10939 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
/tmp/dist-test-taskoRpd7b/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:39721
--webserver_interface=127.10.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab
--principal=kudu/127.10.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.174.212:40963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.174.254:43555,127.10.174.253:35387,127.10.174.252:39721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 18:47:53.362076 2084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:53.362946 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.362642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36302)
0807 18:47:53.362751 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.362846 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 18:47:53.363159 2032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
I20260807 18:47:53.364085 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.363859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36312)
0807 18:47:53.363968 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.364018 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 18:47:53.364282 2084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39721: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
I20260807 18:47:53.364768 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.353938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58848)
0807 18:47:53.354102 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.354121 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.354251 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.354609 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.354612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.354815 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.355396 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.355406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.356300 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.356307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.356918 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.356927 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.357580 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.357588 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.357731 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.358239 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.358252 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.359851 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.362053 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.362057 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.362059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.362343 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.362697 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.362703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.362707 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.362835 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.364319 (+ 1484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.364322 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.364438 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.364533 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.364653 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 18:47:53.365298 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.354025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58848 (local address 127.10.174.253:35387)
0807 18:47:53.354399 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.354413 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.354424 (+ 11us) server_negotiation.cc:407] Connection header received
0807 18:47:53.354453 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.354455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.354490 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.354586 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.355519 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.356155 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.357039 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.357416 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.357574 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.360027 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.360033 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.360039 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.360071 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.361923 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.362488 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.362491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.362492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.362580 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.362949 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.362954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.362959 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.364170 (+ 1211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.364989 (+ 819us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.365074 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.365174 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":150,"threads_started":1}
I20260807 18:47:53.365979 2006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:53.366740 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.366503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36328)
0807 18:47:53.366625 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.366681 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 18:47:53.367528 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.367271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36332)
0807 18:47:53.367439 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.367481 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260807 18:47:53.367704 2006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39721: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
I20260807 18:47:53.398897 2006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } attempt: 1
I20260807 18:47:53.399884 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.399553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36344)
0807 18:47:53.399732 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.399801 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 18:47:53.400820 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.400609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36360)
0807 18:47:53.400718 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.400763 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 18:47:53.400995 2006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39721: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
I20260807 18:47:53.413571 2084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } attempt: 1
I20260807 18:47:53.414475 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.414173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36376)
0807 18:47:53.414333 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.414395 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 18:47:53.415202 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.414996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36384)
0807 18:47:53.415099 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.415152 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 18:47:53.415354 2084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39721: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
I20260807 18:47:53.476169 2006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } attempt: 2
I20260807 18:47:53.477089 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.476738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36398)
0807 18:47:53.476894 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.477007 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 18:47:53.476940 2091 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 18:47:53.477236 2091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 18:47:53.477285 2091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 18:47:53.477382 2091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 18:47:53.478024 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.477613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36410)
0807 18:47:53.477725 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.477958 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 18:47:53.478190 2006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39721: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
W20260807 18:47:53.481609 2091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 18:47:53.481693 2091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 18:47:53.481760 2091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 18:47:53.481820 2091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 18:47:53.481856 2091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 18:47:53.483498 2084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } attempt: 2
I20260807 18:47:53.484228 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.483959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36422)
0807 18:47:53.484092 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.484156 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 18:47:53.484995 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.484731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36436)
0807 18:47:53.484880 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.484933 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260807 18:47:53.485145 2084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.174.252:39721: Network error: Client connection negotiation failed: client connection to 127.10.174.252:39721: connect: Connection refused (error 111)
I20260807 18:47:53.487690 2091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.174.212:40963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.174.254:43555,127.10.174.253:35387,127.10.174.252:39721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/krb5kdc/kudu_127.10.174.252.keytab
--principal=kudu/127.10.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.174.252:39721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 17:57:58 UTC on ccycloud.quasar-thtedw.root.comops.site
build id 4573428
I20260807 18:47:53.488792 2091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 18:47:53.489786 2091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 18:47:53.499040 2100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 18:47:53.499040 2097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:53.499332 2091 server_base.cc:1034] running on GCE node
W20260807 18:47:53.499040 2098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 18:47:53.500065 2091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 18:47:53.501111 2091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 18:47:53.502303 2091 hybrid_clock.cc:648] HybridClock initialized: now 1786128473502287 us; error 35 us; skew 500 ppm
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 18:47:53.505239 2091 init.cc:377] Logged in from keytab as kudu/127.10.174.252@KRBTEST.COM (short username kudu)
I20260807 18:47:53.506165 2091 webserver.cc:460] Webserver started at http://127.10.174.252:39903/ using document root <none> and password file <none>
I20260807 18:47:53.506733 2091 fs_manager.cc:359] Metadata directory not provided
I20260807 18:47:53.506825 2091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 18:47:53.507058 2091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 18:47:53.509114 2091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data/instance:
uuid: "ebf817f2dc304cbfa42423ba097583bb"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "fd5ba1edcf0e265639c164c5cd254621"
server_key_iv: "1aafed97c90adf8525a80fe9744ac8aa"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.509694 2091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal/instance:
uuid: "ebf817f2dc304cbfa42423ba097583bb"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "fd5ba1edcf0e265639c164c5cd254621"
server_key_iv: "1aafed97c90adf8525a80fe9744ac8aa"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.513362 2091 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 18:47:53.515734 2107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 18:47:53.516906 2091 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 18:47:53.517048 2091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data,/tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal
uuid: "ebf817f2dc304cbfa42423ba097583bb"
format_stamp: "Formatted at 2026-08-07 18:47:53 on dist-test-slave-07c2"
server_key: "fd5ba1edcf0e265639c164c5cd254621"
server_key_iv: "1aafed97c90adf8525a80fe9744ac8aa"
server_key_version: "encryptionkey@0"
I20260807 18:47:53.517154 2091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 18:47:53.528446 2091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 18:47:53.531680 2091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 18:47:53.531878 2091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 18:47:53.538866 2091 rpc_server.cc:307] RPC server started. Bound to: 127.10.174.252:39721
I20260807 18:47:53.539279 2159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.174.252:39721 every 8 connection(s)
I20260807 18:47:53.539870 2091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/data/info.pb
I20260807 18:47:53.542552 2160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 18:47:53.546308 2160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:53.547996 10939 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu as pid 2091
I20260807 18:47:53.548141 10939 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskoRpd7b/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786128190976416-10939-0/minicluster-data/master-2/wal/instance
I20260807 18:47:53.548480 10939 external_mini_cluster.cc:1428] Setting key d7718bc7e5240c7c13eb4eefe70f6c0b
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:47:53.561383 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.548343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.10.174.254:43555)
0807 18:47:53.548575 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.548581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.549644 (+ 1063us) server_negotiation.cc:407] Connection header received
0807 18:47:53.550713 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.550717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.550773 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.550876 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.552052 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.552849 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.554213 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.554545 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.554654 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.557645 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.557651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.557657 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.557696 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.559342 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.559845 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.559849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.559851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.559938 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.560331 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.560335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.560337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.560550 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.560665 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.561084 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.561214 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260807 18:47:53.562345 2162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.548883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.254:43555 (local address 127.0.0.1:52540)
0807 18:47:53.549472 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.549536 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.550499 (+ 963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.550958 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.550964 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.551524 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.551895 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.551916 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.552965 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.552968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.554085 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.554096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.554696 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.554699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.554840 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.555571 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.555594 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.557442 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.559475 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.559486 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.559496 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.559737 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.560037 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.560040 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.560042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.560225 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.560677 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.560685 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.560866 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.561042 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.561374 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"spinlock_wait_cycles":1280,"thread_start_us":161,"threads_started":1}
I20260807 18:47:53.562346 2164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.549229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36442 (local address 127.10.174.252:39721)
0807 18:47:53.549634 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.549649 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.549714 (+ 65us) server_negotiation.cc:407] Connection header received
0807 18:47:53.550511 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.550533 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.550804 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.550988 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.551919 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.553160 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.554305 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.554848 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.554927 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.557957 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.557962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.557973 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.557994 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.559596 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.560054 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.560064 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.560065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.560199 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.560489 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.560493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.560495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.560859 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.561076 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.561286 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.561442 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":128,"threads_started":1}
I20260807 18:47:53.563920 2160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.254@KRBTEST.COM
I20260807 18:47:53.574397 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.564767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58854 (local address 127.10.174.253:35387)
0807 18:47:53.564892 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.564897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.564911 (+ 14us) server_negotiation.cc:407] Connection header received
0807 18:47:53.564955 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.564958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.565013 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.565085 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.565746 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.566525 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.567608 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.567925 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.568028 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.570265 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.570269 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.570272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.570305 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.572076 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.572745 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.572750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.572752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.572849 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.573203 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.573207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.573210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.573590 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.573704 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.574060 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.574218 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 18:47:53.574935 2162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.564450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.253:35387 (local address 127.0.0.1:58854)
0807 18:47:53.564591 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.564610 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.564696 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.565221 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.565223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.565442 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.565590 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.565599 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.566661 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.566664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.567497 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.567507 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.568036 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.568039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.568117 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.568650 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.568681 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.570082 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.572197 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.572202 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.572207 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.572617 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.572975 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.572979 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.572981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.573081 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.573754 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.573760 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.573862 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.574624 (+ 762us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.574780 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 18:47:53.575413 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.564997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52554 (local address 127.10.174.254:43555)
0807 18:47:53.565118 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.565121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.565133 (+ 12us) server_negotiation.cc:407] Connection header received
0807 18:47:53.565164 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.565166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.565229 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.565294 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.566041 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.566726 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.567786 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.568102 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.568194 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.570835 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.570838 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.570840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.570863 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.572691 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.573252 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.573257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.573260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.573343 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.573688 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.573692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.573693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.573922 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.574147 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.574728 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.574926 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:47:53.575714 2160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } has no permanent_uuid. Determining permanent_uuid...
I20260807 18:47:53.576293 2084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } attempt: 3
I20260807 18:47:53.577471 2006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } attempt: 3
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.252@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.174.253@KRBTEST.COM
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.253@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:47:53.586692 2164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.576408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36444 (local address 127.10.174.252:39721)
0807 18:47:53.576541 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.576545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.576657 (+ 112us) server_negotiation.cc:407] Connection header received
0807 18:47:53.576788 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.576791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.576857 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.576909 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.577395 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.578205 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.579216 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.579644 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.579725 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.582171 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.582175 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.582177 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.582200 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.584927 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.585417 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.585420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.585422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.585508 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.585798 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.585801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.585803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.586001 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.586094 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.586390 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.586535 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":62}
I20260807 18:47:53.586692 2162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.576257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36444)
0807 18:47:53.576595 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.576607 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.576704 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.577024 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.577026 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.577191 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.577278 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.577284 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.578326 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.578330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.579103 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.579113 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.579858 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.579861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.579944 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.580433 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.580451 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.582023 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.585038 (+ 3015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.585042 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.585044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.585308 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.585611 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.585614 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.585616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.585714 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.586141 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.586144 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.586220 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.586336 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.586481 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296}
Aug 07 18:47:53 dist-test-slave-07c2 krb5kdc[1923](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786128473, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.174.254@KRBTEST.COM for kudu/127.10.174.252@KRBTEST.COM
I20260807 18:47:53.590543 2160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: Bootstrap starting.
I20260807 18:47:53.591178 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.577753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58862 (local address 127.10.174.253:35387)
0807 18:47:53.577879 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.577886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.578595 (+ 709us) server_negotiation.cc:407] Connection header received
0807 18:47:53.578767 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.578770 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.578823 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.578878 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.580056 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.580802 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.581912 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.582240 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.582322 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.587128 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.587135 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.587139 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.587169 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.588919 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.589488 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.589493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.589496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.589608 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.589959 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.589963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.589964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.590224 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.590447 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.590853 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.590981 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 18:47:53.592336 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.577134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36452)
0807 18:47:53.577298 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.577311 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.577384 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.578436 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.578439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.578752 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.578898 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.578907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.582185 (+ 3278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.582189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.582810 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.582820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.583500 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.583505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.583607 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.584081 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.584092 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.586005 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.590562 (+ 4557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.590565 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.590567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.590827 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.591152 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.591155 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.591157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.591245 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.591855 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.591859 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.591957 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.592055 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.592201 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260807 18:47:53.593053 2165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.576806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36452 (local address 127.10.174.252:39721)
0807 18:47:53.578159 (+ 1353us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.578167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.578180 (+ 13us) server_negotiation.cc:407] Connection header received
0807 18:47:53.578211 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.578214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.578258 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.579032 (+ 774us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.579367 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.581671 (+ 2304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.582937 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.583354 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.583827 (+ 473us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.586702 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.586709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.586718 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.586746 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.590447 (+ 3701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.590945 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.590950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.590954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.591033 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.591391 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.591394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.591395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.591686 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.592614 (+ 928us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.592693 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.592813 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1280,"thread_start_us":136,"threads_started":1}
I20260807 18:47:53.593231 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.578114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.174.252:39721 (local address 127.0.0.1:36456)
0807 18:47:53.578273 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 18:47:53.578287 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 18:47:53.578364 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 18:47:53.581055 (+ 2691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 18:47:53.581058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 18:47:53.581331 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0807 18:47:53.581476 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.581484 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.584780 (+ 3296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.584786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.585573 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 18:47:53.585584 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.586293 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.586298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 18:47:53.586400 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.586873 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 18:47:53.586890 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 18:47:53.588750 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 18:47:53.591079 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.591082 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.591084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.591362 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.591978 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 18:47:53.591982 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 18:47:53.591985 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 18:47:53.592079 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 18:47:53.592775 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 18:47:53.592778 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 18:47:53.592870 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 18:47:53.592947 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 18:47:53.593075 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260807 18:47:53.594329 2160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:53.594429 2166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.579687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36456 (local address 127.10.174.252:39721)
0807 18:47:53.579999 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.580695 (+ 696us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.580717 (+ 22us) server_negotiation.cc:407] Connection header received
0807 18:47:53.580780 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.580783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.580830 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.581637 (+ 807us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.581804 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.584622 (+ 2818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.585674 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.586001 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.586097 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.588907 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.588912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.588917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.588940 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.590951 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.591777 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.591780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.591781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.591861 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.592216 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.592218 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.592220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.592658 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.593980 (+ 1322us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.594049 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.594179 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":105,"threads_started":1}
I20260807 18:47:53.595149 2160 log.cc:824] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:53.595425 10939 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 18:47:53.596200 2084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: Bootstrap starting.
I20260807 18:47:53.596587 1979 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "fd13bbba716648978b0b20c40db2d8fe"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52554
I20260807 18:47:53.597822 2006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe: Bootstrap starting.
I20260807 18:47:53.598912 2084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:53.599862 2084 log.cc:824] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:53.600440 2006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe: Neither blocks nor log segments found. Creating new log.
I20260807 18:47:53.601115 2006 log.cc:824] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe: Log is configured to *not* fsync() on all Append() calls
I20260807 18:47:53.601320 2160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: No bootstrap required, opened a new log
I20260807 18:47:53.602272 2084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: No bootstrap required, opened a new log
I20260807 18:47:53.603699 2006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe: No bootstrap required, opened a new log
I20260807 18:47:53.605301 2160 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.605545 2160 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebf817f2dc304cbfa42423ba097583bb, State: Initialized, Role: FOLLOWER
I20260807 18:47:53.605842 2160 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.606349 2170 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.606554 2170 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.606508 2084 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.606774 2084 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfb7d32c26f446a2a6b03b67abc2847a, State: Initialized, Role: FOLLOWER
I20260807 18:47:53.607106 2084 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.607442 2160 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:53.607702 2171 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.607939 2171 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.608459 2084 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:53.608304 2006 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.608675 2006 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd13bbba716648978b0b20c40db2d8fe, State: Initialized, Role: FOLLOWER
I20260807 18:47:53.609228 2006 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.611631 1979 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 18:47:53.611761 1979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 0 FOLLOWER]: Advancing to term 1
W20260807 18:47:53.612684 2182 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:53.612833 2182 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:53.613152 1979 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.614121 1979 leader_election.cc:288] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [CANDIDATE]: Term 1 election: Requested vote from peers dfb7d32c26f446a2a6b03b67abc2847a (127.10.174.253:35387), ebf817f2dc304cbfa42423ba097583bb (127.10.174.252:39721)
I20260807 18:47:53.614287 2006 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 18:47:53.611513 2091 master_runner.cc:186] Error getting master registration for 127.10.174.254:43555: OK, instance_id { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" instance_seqno: 1786128473107270 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:47:53.614530 2091 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:47:53.614660 2057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd13bbba716648978b0b20c40db2d8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dfb7d32c26f446a2a6b03b67abc2847a"
I20260807 18:47:53.614918 2057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:53.615249 2134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd13bbba716648978b0b20c40db2d8fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ebf817f2dc304cbfa42423ba097583bb"
I20260807 18:47:53.615489 2134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 18:47:53.612361 2014 master_runner.cc:186] Error getting master registration for 127.10.174.254:43555: OK, instance_id { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" instance_seqno: 1786128473107270 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 18:47:53.615774 2014 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:47:53.616407 2057 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd13bbba716648978b0b20c40db2d8fe in term 1.
I20260807 18:47:53.616834 2134 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd13bbba716648978b0b20c40db2d8fe in term 1.
I20260807 18:47:53.617270 1954 leader_election.cc:302] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ebf817f2dc304cbfa42423ba097583bb, fd13bbba716648978b0b20c40db2d8fe; no voters:
W20260807 18:47:53.619453 2195 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:53.619525 2195 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 18:47:53.621692 2206 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 18:47:53.621773 2206 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 18:47:53.621974 2183 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.622087 2183 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.622169 2183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 18:47:53.622241 2183 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [term 1 LEADER]: Becoming Leader. State: Replica: fd13bbba716648978b0b20c40db2d8fe, State: Running, Role: LEADER
I20260807 18:47:53.622568 2183 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } }
I20260807 18:47:53.623361 1936 master_runner.cc:263] No leader master found from master fd13bbba716648978b0b20c40db2d8fe
I20260807 18:47:53.623423 1936 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 18:47:53.629137 2183 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd13bbba716648978b0b20c40db2d8fe. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.629524 2183 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:53.644476 2166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.627776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36472 (local address 127.10.174.252:39721)
0807 18:47:53.627914 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.627919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.630034 (+ 2115us) server_negotiation.cc:407] Connection header received
0807 18:47:53.630235 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.630239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.630287 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.630339 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.631642 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.632478 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.633674 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.634085 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.634161 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.638043 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.638047 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.638050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.638080 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.639921 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.641570 (+ 1649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.641574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.641576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.641680 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.643089 (+ 1409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.643093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.643095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.643368 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.643491 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.644112 (+ 621us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.644255 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 18:47:53.648723 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.630818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58870 (local address 127.10.174.253:35387)
0807 18:47:53.630953 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.630959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.639607 (+ 8648us) server_negotiation.cc:407] Connection header received
0807 18:47:53.639823 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.639827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.639900 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.639958 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.640855 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.641622 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.642948 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.643306 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.643395 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.645025 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.645029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.645032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.645060 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.646635 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.647103 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.647106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.647108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.647204 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.647597 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.647601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.647604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.647854 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.647964 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.648387 (+ 423us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.648514 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:47:53.652459 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:53.628499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52566 (local address 127.10.174.254:43555)
0807 18:47:53.628626 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.628630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.629698 (+ 1068us) server_negotiation.cc:407] Connection header received
0807 18:47:53.629847 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.629850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.629906 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.629993 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.636076 (+ 6083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.636854 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.640518 (+ 3664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:53.640880 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:53.640959 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:53.647058 (+ 6099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 18:47:53.647063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 18:47:53.647067 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 18:47:53.647105 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 18:47:53.648939 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.651050 (+ 2111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.651055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.651059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.651154 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 18:47:53.651521 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 18:47:53.651524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 18:47:53.651526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 18:47:53.651738 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 18:47:53.651846 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:53.652163 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 18:47:53.652296 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 18:47:53.652778 2218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 18:47:53.653906 2218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 18:47:53.660463 2134 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [term 1 FOLLOWER]: Refusing update from remote peer fd13bbba716648978b0b20c40db2d8fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:53.661141 2183 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:53.665146 2170 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd13bbba716648978b0b20c40db2d8fe. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.665279 2170 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.667855 2057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [term 1 FOLLOWER]: Refusing update from remote peer fd13bbba716648978b0b20c40db2d8fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 18:47:53.668495 2183 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 18:47:53.672513 2171 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd13bbba716648978b0b20c40db2d8fe. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.672678 2171 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.678153 2210 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.678309 2210 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:53.678650 2219 mvcc.cc:205] Tried to move back new op lower bound from 7315982228101234688 to 7315982227979517952. Current Snapshot: MvccSnapshot[applied={T|T < 7315982228101234688}]
I20260807 18:47:53.678670 2170 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.678792 2170 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.679211 2220 mvcc.cc:205] Tried to move back new op lower bound from 7315982228101234688 to 7315982227979517952. Current Snapshot: MvccSnapshot[applied={T|T < 7315982228101234688}]
I20260807 18:47:53.679351 2183 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.679474 2183 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe [sys.catalog]: This master's current role is: LEADER
I20260807 18:47:53.680497 2171 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fd13bbba716648978b0b20c40db2d8fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd13bbba716648978b0b20c40db2d8fe" member_type: VOTER last_known_addr { host: "127.10.174.254" port: 43555 } } peers { permanent_uuid: "dfb7d32c26f446a2a6b03b67abc2847a" member_type: VOTER last_known_addr { host: "127.10.174.253" port: 35387 } } peers { permanent_uuid: "ebf817f2dc304cbfa42423ba097583bb" member_type: VOTER last_known_addr { host: "127.10.174.252" port: 39721 } } }
I20260807 18:47:53.680620 2171 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 18:47:53.681713 2222 mvcc.cc:205] Tried to move back new op lower bound from 7315982228101234688 to 7315982227979517952. Current Snapshot: MvccSnapshot[applied={T|T < 7315982228101234688}]
I20260807 18:47:53.685148 2218 catalog_manager.cc:1347] Generated new cluster ID: 92fb644108844e48bc373370d9d3b1b4
I20260807 18:47:53.685223 2218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 18:47:53.709028 2218 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 18:47:53.711043 2218 catalog_manager.cc:1504] Loading token signing keys...
I20260807 18:47:53.730903 2218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd13bbba716648978b0b20c40db2d8fe: Generated new TSK 0
I20260807 18:47:53.731931 2218 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 18:47:53.771034 2010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.767728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52582 (local address 127.10.174.254:43555)
0807 18:47:53.767876 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.767881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.769844 (+ 1963us) server_negotiation.cc:407] Connection header received
0807 18:47:53.770069 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.770073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.770128 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.770184 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.770894 (+ 710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52582: BlockingRecv error: recv got EOF from 127.0.0.1:52582 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 18:47:53.772583 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.768559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.10.174.253:35387)
0807 18:47:53.768674 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.768678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.771573 (+ 2895us) server_negotiation.cc:407] Connection header received
0807 18:47:53.771693 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.771698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.771755 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.771906 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.772445 (+ 539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58876: BlockingRecv error: recv got EOF from 127.0.0.1:58876 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 18:47:53.772943 2166 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.769216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36482 (local address 127.10.174.252:39721)
0807 18:47:53.769329 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.769333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.771973 (+ 2640us) server_negotiation.cc:407] Connection header received
0807 18:47:53.772149 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.772153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.772208 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.772259 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.772833 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36482: BlockingRecv error: recv got EOF from 127.0.0.1:36482 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 18:47:53.777596 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.775901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58892 (local address 127.10.174.253:35387)
0807 18:47:53.776016 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.776021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.776540 (+ 519us) server_negotiation.cc:407] Connection header received
0807 18:47:53.776780 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.776784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.776858 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.776949 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.777492 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58892: BlockingRecv error: recv got EOF from 127.0.0.1:58892 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 18:47:53.783074 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.781434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58900 (local address 127.10.174.253:35387)
0807 18:47:53.781541 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.781545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.782089 (+ 544us) server_negotiation.cc:407] Connection header received
0807 18:47:53.782292 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.782295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.782345 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.782400 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.782956 (+ 556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58900: BlockingRecv error: recv got EOF from 127.0.0.1:58900 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 18:47:53.789238 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.787498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58902 (local address 127.10.174.253:35387)
0807 18:47:53.787612 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.787616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.788179 (+ 563us) server_negotiation.cc:407] Connection header received
0807 18:47:53.788381 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.788385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.788437 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.788489 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.789124 (+ 635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58902: BlockingRecv error: recv got EOF from 127.0.0.1:58902 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 18:47:53.797624 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.795805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58904 (local address 127.10.174.253:35387)
0807 18:47:53.795958 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.795964 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.796579 (+ 615us) server_negotiation.cc:407] Connection header received
0807 18:47:53.796812 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.796816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.796872 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.796929 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.797507 (+ 578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58904: BlockingRecv error: recv got EOF from 127.0.0.1:58904 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 18:47:53.810417 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.808260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58914 (local address 127.10.174.253:35387)
0807 18:47:53.808397 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.808402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.809136 (+ 734us) server_negotiation.cc:407] Connection header received
0807 18:47:53.809372 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.809376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.809438 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.809499 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.810289 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58914: BlockingRecv error: recv got EOF from 127.0.0.1:58914 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 18:47:53.830657 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.828945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.10.174.253:35387)
0807 18:47:53.829087 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.829091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.829682 (+ 591us) server_negotiation.cc:407] Connection header received
0807 18:47:53.829897 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.829901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.829953 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.830005 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.830536 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58922: BlockingRecv error: recv got EOF from 127.0.0.1:58922 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 18:47:53.866463 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.865222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58936 (local address 127.10.174.253:35387)
0807 18:47:53.865396 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.865401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.865555 (+ 154us) server_negotiation.cc:407] Connection header received
0807 18:47:53.865731 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.865734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.865792 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.865886 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.866353 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58936: BlockingRecv error: recv got EOF from 127.0.0.1:58936 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260807 18:47:53.933998 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:53.932811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58940 (local address 127.10.174.253:35387)
0807 18:47:53.932973 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:53.932980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:53.933118 (+ 138us) server_negotiation.cc:407] Connection header received
0807 18:47:53.933252 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:53.933255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:53.933305 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:53.933379 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:53.933868 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58940: BlockingRecv error: recv got EOF from 127.0.0.1:58940 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 18:47:54.065738 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:54.064399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58946 (local address 127.10.174.253:35387)
0807 18:47:54.064616 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.064622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.064741 (+ 119us) server_negotiation.cc:407] Connection header received
0807 18:47:54.064931 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.064934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.064992 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.065089 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:54.065610 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58946: BlockingRecv error: recv got EOF from 127.0.0.1:58946 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 18:47:54.325357 2090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 18:47:54.324174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58950 (local address 127.10.174.253:35387)
0807 18:47:54.324322 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.324325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.324424 (+ 99us) server_negotiation.cc:407] Connection header received
0807 18:47:54.324574 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.324576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.324625 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.324698 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 18:47:54.325241 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58950: BlockingRecv error: recv got EOF from 127.0.0.1:58950 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 18:47:54.614262 2182 catalog_manager.cc:1259] Loaded cluster ID: 92fb644108844e48bc373370d9d3b1b4
I20260807 18:47:54.614373 2182 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: loading cluster ID for follower catalog manager: success
I20260807 18:47:54.616297 2182 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: acquiring CA information for follower catalog manager: success
I20260807 18:47:54.617426 2182 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ebf817f2dc304cbfa42423ba097583bb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:47:54.620675 2195 catalog_manager.cc:1259] Loaded cluster ID: 92fb644108844e48bc373370d9d3b1b4
I20260807 18:47:54.620738 2195 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: loading cluster ID for follower catalog manager: success
I20260807 18:47:54.622433 2195 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: acquiring CA information for follower catalog manager: success
I20260807 18:47:54.623507 2195 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dfb7d32c26f446a2a6b03b67abc2847a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 18:47:54.843802 2292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:54.839608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58958 (local address 127.10.174.253:35387)
0807 18:47:54.839878 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.839883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.840006 (+ 123us) server_negotiation.cc:407] Connection header received
0807 18:47:54.840185 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.840188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.840333 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.840461 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:54.840742 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.841270 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.842168 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.842408 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.842524 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:54.842862 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:54.843363 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:54.843495 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:54.843576 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 18:47:54.843635 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":75,"threads_started":1}
I20260807 18:47:54.850658 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:54.846960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36488 (local address 127.10.174.252:39721)
0807 18:47:54.847227 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.847231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.847342 (+ 111us) server_negotiation.cc:407] Connection header received
0807 18:47:54.847519 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.847521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.847638 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.847736 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:54.847938 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.848489 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.849317 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.849530 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.849605 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:54.849850 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:54.850245 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:54.850348 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:54.850406 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 18:47:54.850458 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":96,"threads_started":1}
I20260807 18:47:54.857600 2292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:54.853725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58966 (local address 127.10.174.253:35387)
0807 18:47:54.853851 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.853855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.854077 (+ 222us) server_negotiation.cc:407] Connection header received
0807 18:47:54.854282 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.854286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.854353 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.854402 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:54.854787 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.855461 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.856450 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.856679 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.856805 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:54.857070 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:54.857138 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:54.857218 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:54.857381 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 18:47:54.857441 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 18:47:54.858518 2298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:54.853996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36496 (local address 127.10.174.252:39721)
0807 18:47:54.854113 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.854120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.854482 (+ 362us) server_negotiation.cc:407] Connection header received
0807 18:47:54.854593 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.854596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.854644 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.854717 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:54.855030 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.855800 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.857281 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.857586 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.857699 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:54.857961 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:54.858035 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:54.858106 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:54.858311 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 18:47:54.858368 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 18:47:54.859231 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 18:47:54.853829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52590 (local address 127.10.174.254:43555)
0807 18:47:54.854197 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0807 18:47:54.854203 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 18:47:54.854240 (+ 37us) server_negotiation.cc:407] Connection header received
0807 18:47:54.854429 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 18:47:54.854435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 18:47:54.854610 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 18:47:54.854733 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 18:47:54.854958 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.855801 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.857286 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 18:47:54.857782 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 18:47:54.857895 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 18:47:54.858328 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 18:47:54.858831 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 18:47:54.858927 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 18:47:54.859026 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 18:47:54.859089 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
I20260807 18:47:54.862525 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 1936
I20260807 18:47:54.871658 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 2014
I20260807 18:47:54.878433 10939 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskoRpd7b/build/debug/bin/kudu with pid 2091
2026-08-07T18:47:54Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3143 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6307 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (283885 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST